-- Logs begin at Fri 2022-06-17 07:57:08 UTC, end at Fri 2022-06-17 09:11:37 UTC. -- Jun 17 08:31:30.579131 dv-cinder-797608-33-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 17 08:31:30.589017 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 08:31:30 2022] *** Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: nodename: dv-cinder-797608-33-iscsi Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: machine: x86_64 Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: clock source: unix Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: pcre jit disabled Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: detected number of CPU cores: 4 Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: current working directory: / Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: detected binary path: /usr/bin/uwsgi-core Jun 17 08:31:30.591009 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: your processes number limit is 47680 Jun 17 08:31:30.591627 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: your memory page size is 4096 bytes Jun 17 08:31:30.591627 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: detected max file descriptor number: 2048 Jun 17 08:31:30.591627 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: lock engine: pthread robust mutexes Jun 17 08:31:30.591627 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: thunder lock: enabled Jun 17 08:31:30.591627 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 17 08:31:30.591627 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 08:31:30.635122 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: Python main interpreter initialized at 0x55e7625059c0 Jun 17 08:31:30.635122 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: python threads support enabled Jun 17 08:31:30.635122 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: your server socket listen backlog is limited to 100 connections Jun 17 08:31:30.635122 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: your mercy for graceful operations on workers is 90 seconds Jun 17 08:31:30.635492 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 08:31:30.635568 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: *** Operational MODE: preforking *** Jun 17 08:31:30.635837 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: *** uWSGI is running in multiple interpreter mode *** Jun 17 08:31:30.635837 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: spawned uWSGI master process (pid: 87039) Jun 17 08:31:30.636042 dv-cinder-797608-33-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 17 08:31:30.637379 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: spawned uWSGI worker 1 (pid: 87051, cores: 1) Jun 17 08:31:30.637379 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: spawned uWSGI worker 2 (pid: 87052, cores: 1) Jun 17 08:31:30.637379 dv-cinder-797608-33-iscsi devstack@keystone.service[87039]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 08:31:36.233319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:31:36.233319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: from cryptography.utils import int_from_bytes Jun 17 08:31:36.234127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:31:36.234127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: from cryptography.utils import int_from_bytes Jun 17 08:31:36.235533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:31:36.235533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: from cryptography.utils import int_from_bytes Jun 17 08:31:36.236602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 08:31:36.236602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: from cryptography.utils import int_from_bytes Jun 17 08:31:36.285526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:31:36.285707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:31:36.285903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] command line args: [] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:31:36.286162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 08:31:36.286243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:31:36.286354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ================================================================================ {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:31:36.286439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 08:31:36.286552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] command line args: [] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 08:31:36.286637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] admin_token = **** {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.286838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 08:31:36.286917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] config_dir = [] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.287023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ================================================================================ {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 08:31:36.287108 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.287211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] config_source = [] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.287292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] admin_token = **** {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.287423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] debug = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.287548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] config_dir = [] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.287637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.287920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.287920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] config_source = [] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.288111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.288207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] debug = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.288310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.288407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.288533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.288637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.288739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.288855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.288957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] list_limit = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.289052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.289152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] log_config_append = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.289252 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.289359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.289462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] list_limit = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.289559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] log_dir = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.289660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] log_config_append = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.289767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] log_file = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.289874 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.289954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.290077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] log_dir = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.290154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.290274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] log_file = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.290274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.290457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.290539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.290619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.290738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.290813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.290933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.291009 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.291138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.291214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.291285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.291389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.291553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.291680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.291791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.291868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.292024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.292109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.292261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.292338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.292498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.292624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.292734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.292822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.292985 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.293103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.293234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.293514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.293590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.293777 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] publish_errors = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.294011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.294100 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.294196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] publish_errors = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.294284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.294416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.294493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.294646 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.294720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.294826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.294923 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.295075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.295159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] standard_threads = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.295311 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.295419 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.295574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] standard_threads = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.295659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.295782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.295865 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.295964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] use_journal = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] use_json = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] use_stderr = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] use_journal = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] use_syslog = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] use_json = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] use_stderr = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] use_syslog = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.296989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.297088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 08:31:36.297234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.297348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.297503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.297586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.297750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.297826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.298007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.298092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.298847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.298949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.299102 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.299334 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.299499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.299730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.299809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.299978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.300061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.300237 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.300320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.300479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.300557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.300731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.300809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.300970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.301046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.301220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.301307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.301460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.301536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.301702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.301787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.301954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.302032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.302196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.302274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.302456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.302634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.302718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.302954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.303036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.303193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.303313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.303517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.303710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.303788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.303973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.304088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.304229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.304465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.304543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.304698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.304815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.304933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.305163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.305252 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.305413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.305526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.305665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.305873 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.305950 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.306121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.306226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.306371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.306578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.306682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.306856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.306969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.307117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.307260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.307371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.307589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.307665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.307828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.308036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.308109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.308284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.308417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.308504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.308683 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.308783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.308926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.309020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.309165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.309313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.309446 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.309575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.309698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.309825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.309947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.310036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.310118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.310191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.310315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.310386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.310547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.310637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.310779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.310864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.311020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.311104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.311258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.311330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.311517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.311611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.311756 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.311836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.311993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.312071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.312226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.312312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.312478 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.312563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.312717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.312819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.312955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.313149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.313227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.313437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.313522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.313677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.313834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.314712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.314802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.314974 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.315081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.315217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.315513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.315609 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.315759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.315878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.316015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.316215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.316293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.316496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.316574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.316736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.316903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.316982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.317220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.317367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.317462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.317625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.317703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.317937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.318014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.318179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.318370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.318448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.318645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.318721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.318883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.318974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.319122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.319201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.319397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.319488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.319643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.319721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.319885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.319965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.320123 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.320205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.320370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.320448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.320610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.320687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.320845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.320922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.321084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.321161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.321319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.321398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.321552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.321629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.321786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.321863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.322022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.322100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.322251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.322335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.322495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.322573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.322734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.322869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.322985 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.323205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.323282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.323493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.323588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.323760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.323926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.324003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.324225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] auth.external = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.324308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.324459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.324640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.324759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.324997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.325079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.325234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] auth.password = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.325353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.325469 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] auth.token = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.325678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.325755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.325938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.326020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.326187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.326314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.326421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.326931 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.327015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.327181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.327292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.327422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.327667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] credential.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.327747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.327919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.328091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.328169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.328342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.328432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.328609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.328683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.328863 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.328939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.329099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.329189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.329345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] auth.external = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.329436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.329610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.329718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.329914 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.330160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.330340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.330419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.330582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] auth.password = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.330707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.330820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] auth.token = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.330963 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.331067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.331234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.331312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.331508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.331601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.331773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.331852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.332014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] federation.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.332092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.332256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.332342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.332506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.332654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.332755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.332985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] credential.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.333063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.333232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.333320 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.333472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.333685 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.333764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.333959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.334072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.334219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.334441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.334519 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.334698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.334826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.334962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.335167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.335294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.335480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.335608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.335743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.335878 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.336001 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.336127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.336251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.336388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.336580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.336715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.336847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.337045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.337172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.337303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.337489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.337628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.337754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.337877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.338001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.338125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.338248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.338393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.338520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.338643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] federation.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.338769 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.338895 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.339019 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.339151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.339278 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.339423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.339545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.339669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.339794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.339930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.340061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.340196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.340321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.340450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.340576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.340708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.340833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.340957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.341082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.341209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.341333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.341465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.341591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.341715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.341849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.341981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.342106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.342238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.342364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.342488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.342613 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.342738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.342870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.342997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.343121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.343244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.343405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.343533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.343679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.343811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.343936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.344060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.344183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.344307 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.344438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.344563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.344688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.344813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.344936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.345076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.345232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.345374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.345500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.345624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.345755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.345887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.346022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.346022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.346259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.346259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.346493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.346616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.346749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.346874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.346997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.347131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.347256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.347393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.347526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.347649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.347772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.347894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.348015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.348136 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.348267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.348390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.348512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.348640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.348773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.348895 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.349024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.349147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.349270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.349392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.349514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.349635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.349768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.349891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.350013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.350135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.350257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.350380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.350518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.350641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.350764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.350885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.351007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.351132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.351260 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.351413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.351548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.351675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.351799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.351922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.352075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.352197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.352331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.352457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.352581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.352704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.352837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.352963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.353086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.353211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.353334 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.353458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.353590 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.353713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.353839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.353962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.354096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.354220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.354351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.354476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.354600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.354723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.354847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.354970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.355101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.355226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.355368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.355491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.355618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.355755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.355891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.356018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.356145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.356270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.356395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.356521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.356661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.356788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.356915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.357046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.357172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] resource.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.357306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.357432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.357568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.357696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.357822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.357949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.358148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.358276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.358403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.358529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.358661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.358789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.358922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.359051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.359176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.359303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.359475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.359600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.359735 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.359860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] role.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.359983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.360107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] role.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.360230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.360353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.360487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.360613 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.361403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.361531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.361658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.361797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.361934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.362061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.362185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.362310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.362434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.362558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.362690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.362816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.362941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.363065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.363188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.363311 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.363498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.363632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.363757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.363880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.364003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.364125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.364256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.364256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.364492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.364614 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.364735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.364857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] resource.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.364987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.365110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.365241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.365364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.365486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.365607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.365737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.365860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.365982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.366104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.366226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.366348 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.366477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.366599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.366721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.366844 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.366974 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.367097 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.367227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.367367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] role.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.367491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.367614 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] role.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.367747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.367883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.368015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.368142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.368265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.368388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.368512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.368660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.368791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.368917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.369041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.369164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.369289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.369420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.369545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] token.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.369669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.369793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.369916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.370039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.370170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.370305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.370430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.370553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.370676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.370800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.370949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.371975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.372936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.connection = **** {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373299 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.373942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] token.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374374 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.374964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.375035 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.375106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.375184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.375258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.375328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.375419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.375491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.375633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.375806 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:31:36.376002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.376253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.377180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.377530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.377790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.378048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.378287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.378535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.378835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.379106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.connection = **** {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.379420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.379646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.379894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.380141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.380385 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.380629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.380871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.381113 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.381364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.381606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.381856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.382098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.382355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.382598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.382849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.383086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.383333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.383600 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 08:31:36.383774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 08:31:36.495156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.495416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.495652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.498536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.498774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.499004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.505143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.508143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.533670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.533904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.534007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.534182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.612660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.613901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.663092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.663266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.663456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.663543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.732424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.732634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.732725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.732864 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.732961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.733086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.733167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.733304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.733395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.733520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.733601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.733736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.757718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.757835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.757982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.758064 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.758127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.758249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.758328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.758474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.758559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.758691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.758772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.758905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.758995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.759120 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.770101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.770718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.783761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.784041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.784128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.784208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.784358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.784443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.784583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.784676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.784803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.784898 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.785020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.785101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87051) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.785234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.785449 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87052) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 08:31:36.802904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.803123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 08:31:36.803496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.803595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.803703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 08:31:36.803785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 08:31:36.803974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.804054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.804234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.804323 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 08:31:36.804494 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.804574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.804751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.804829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.805009 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.805265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.815791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.816070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.816343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.816551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.816646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.816832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.817125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.817407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.824855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.825637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.828444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.828724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.829004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.829199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.829294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.829524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.829609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.829830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.830025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.830146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.832051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.832204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.832285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.832359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.832359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.833305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.833305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.833448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.833448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.833448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.833448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.833448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.857982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.859272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.859621 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.859904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.861722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.862120 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.865770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.866166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.866451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.867404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.867800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.868081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.873744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.874027 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.875325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.875630 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.878536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.878820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.879103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.879407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.879683 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.879961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.880231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.880476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.880569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.880763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.881045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.881326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.881597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.881868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.882138 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.882406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.899612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.899887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.901440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.901717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.904455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.906261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.908778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.909177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.910835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.911232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.914189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.916265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.917878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.919925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.921514 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.921815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.922103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.922386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.922661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.922948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.924375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.924679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.924964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.925248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.925528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.925817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.942741 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.943021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.943288 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.943584 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.945272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.945557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.945827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.946092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.951501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.953497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.954013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.954289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.956871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.957157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.959111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.959436 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.959719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.960019 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.960297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.961600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.961884 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.962182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.962472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.962751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.976245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.976749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.976886 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.977061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.977172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.977343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.977455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.977718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.977802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.977997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.978090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.978277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.978358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.978624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:36.996653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.996877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:36.999931 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:37.000144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:37.003448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.003888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.005374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.005661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.007036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:37.007302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:37.007403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.007621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.007717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.007949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.014886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.015130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.016538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:37.016771 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:37.020335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.020629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.020851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.021024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.021141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.021313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.021537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.021824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.030530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:37.030848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.030969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:37.031095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.031256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.031561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.039634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87051) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:37.039912 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.040193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.040351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87052) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 08:31:37.040470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.040631 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.040753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.040910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.041133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.041213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.041420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.041510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.041700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.041820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.041976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.042097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.042248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.042371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.042522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.042640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.042806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.042910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.043075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.043190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.043338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87051) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.043498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.043777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.044037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87052) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 08:31:37.081786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e7625059c0 pid: 87051 (default app) Jun 17 08:31:37.084310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e7625059c0 pid: 87052 (default app) Jun 17 08:31:37.085500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8b9ab-b151-403c-93b4-6ee68559c335 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:37.085801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8b9ab-b151-403c-93b4-6ee68559c335 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:37.086084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8b9ab-b151-403c-93b4-6ee68559c335 None None] PATH_INFO: `/v3` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:37.090305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 791 bytes} [Fri Jun 17 08:31:37 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:31:45.727659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa8f3-0a7b-48dd-9f5b-39aa112d8ff0 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:45.728188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa8f3-0a7b-48dd-9f5b-39aa112d8ff0 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:45.728188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa8f3-0a7b-48dd-9f5b-39aa112d8ff0 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:45.732427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1/2] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:45.738936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:45.739390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:45.739571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:45.809286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: INFO dbcounter [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] Registered counter for database keystone Jun 17 08:31:45.830672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG oslo_db.sqlalchemy.engines [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87051) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:31:45.836940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writer thread running {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:31:46.015829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG passlib.handlers.bcrypt [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87051) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 08:31:46.016248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG passlib.handlers.bcrypt [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87051) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 08:31:46.071435 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:46.073045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:46.211363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 2/3] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 17 08:31:46.381148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaa8f3-0a7b-48dd-9f5b-39aa112d8ff0 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:46.461139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: INFO dbcounter [None req-34eaa8f3-0a7b-48dd-9f5b-39aa112d8ff0 None None] Registered counter for database keystone Jun 17 08:31:46.481711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG oslo_db.sqlalchemy.engines [None req-34eaa8f3-0a7b-48dd-9f5b-39aa112d8ff0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 08:31:46.488755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writer thread running {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 08:31:46.625226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaa8f3-0a7b-48dd-9f5b-39aa112d8ff0 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:46.632295 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502efdcc-4baf-43f1-97cb-2ac8f25b6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:46.633881 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502efdcc-4baf-43f1-97cb-2ac8f25b6c45 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:46.633881 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502efdcc-4baf-43f1-97cb-2ac8f25b6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:46.633881 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502efdcc-4baf-43f1-97cb-2ac8f25b6c45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:46.642875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502efdcc-4baf-43f1-97cb-2ac8f25b6c45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:46.699217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: WARNING keystone.common.rbac_enforcer.enforcer [None req-502efdcc-4baf-43f1-97cb-2ac8f25b6c45 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 08:31:46.699587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502efdcc-4baf-43f1-97cb-2ac8f25b6c45 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:46.712099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 2/4] 10.222.0.78 () {58 vars in 1324 bytes} [Fri Jun 17 08:31:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:31:46.718120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:46.738311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd3e0c-ed38-41ca-ad9a-6f86f8890ae6 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:46.743082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec49512-0357-44ef-b8b9-e1a6eef9a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:46.744799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec49512-0357-44ef-b8b9-e1a6eef9a3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:46.745085 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec49512-0357-44ef-b8b9-e1a6eef9a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:46.745364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec49512-0357-44ef-b8b9-e1a6eef9a3b4 admin admin] PATH_INFO: `/v3/projects/9bb6ac161b2c421f94fa26d18ee99634` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:46.746946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec49512-0357-44ef-b8b9-e1a6eef9a3b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=9bb6ac161b2c421f94fa26d18ee99634)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:46.813359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: WARNING keystone.common.rbac_enforcer.enforcer [None req-aec49512-0357-44ef-b8b9-e1a6eef9a3b4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 08:31:46.814580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec49512-0357-44ef-b8b9-e1a6eef9a3b4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:46.821062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 3/5] 10.222.0.78 () {56 vars in 1207 bytes} [Fri Jun 17 08:31:46 2022] GET /identity/v3/projects/9bb6ac161b2c421f94fa26d18ee99634 => generated 344 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:31:48.934705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3385-4b23-4f4d-9f69-4d4b4c0679a5 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.935237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3385-4b23-4f4d-9f69-4d4b4c0679a5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.935237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3385-4b23-4f4d-9f69-4d4b4c0679a5 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.939392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 3/6] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:48.944804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c2166-19e8-49e7-ba21-6e904a3f3460 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:48.945216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c2166-19e8-49e7-ba21-6e904a3f3460 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:48.945362 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c2166-19e8-49e7-ba21-6e904a3f3460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:48.964725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b34c2166-19e8-49e7-ba21-6e904a3f3460 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:48.966516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b34c2166-19e8-49e7-ba21-6e904a3f3460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:48.975005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 4/7] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 17 08:31:48.996883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3385-4b23-4f4d-9f69-4d4b4c0679a5 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:49.009103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce3385-4b23-4f4d-9f69-4d4b4c0679a5 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:49.013321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bd4ba-0fcb-4477-997b-0988b4a8f077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:49.013952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bd4ba-0fcb-4477-997b-0988b4a8f077 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:49.014237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bd4ba-0fcb-4477-997b-0988b4a8f077 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:49.014517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bd4ba-0fcb-4477-997b-0988b4a8f077 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:49.022837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6bd4ba-0fcb-4477-997b-0988b4a8f077 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:49.024641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6bd4ba-0fcb-4477-997b-0988b4a8f077 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:49.034100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 4/8] 10.222.0.78 () {58 vars in 1324 bytes} [Fri Jun 17 08:31:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:31:49.039426 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c2166-19e8-49e7-ba21-6e904a3f3460 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:49.049146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c2166-19e8-49e7-ba21-6e904a3f3460 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:49.053588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c1c70-6e70-41ab-8fd3-f92034418fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:49.054450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c1c70-6e70-41ab-8fd3-f92034418fcf admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:49.054736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c1c70-6e70-41ab-8fd3-f92034418fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:49.055017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c1c70-6e70-41ab-8fd3-f92034418fcf admin admin] PATH_INFO: `/v3/users/1449ff4f407540dd843ab2db406229f6` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:49.056451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c1c70-6e70-41ab-8fd3-f92034418fcf admin admin] RBAC: Authorizing `identity:get_user(user_id=1449ff4f407540dd843ab2db406229f6)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:49.058276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c1c70-6e70-41ab-8fd3-f92034418fcf admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:49.059883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 5/9] 10.222.0.78 () {56 vars in 1198 bytes} [Fri Jun 17 08:31:49 2022] GET /identity/v3/users/1449ff4f407540dd843ab2db406229f6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:31:51.242151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8a85a-3d6c-4385-a1ac-f8a92f57b8fe None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:51.242701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8a85a-3d6c-4385-a1ac-f8a92f57b8fe None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:51.242701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8a85a-3d6c-4385-a1ac-f8a92f57b8fe None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:51.244142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 5/10] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:51.249682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65402d16-6991-4478-8ab5-4d227ef41862 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:51.250169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65402d16-6991-4478-8ab5-4d227ef41862 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:51.250249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65402d16-6991-4478-8ab5-4d227ef41862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:51.267592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-65402d16-6991-4478-8ab5-4d227ef41862 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:51.268775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-65402d16-6991-4478-8ab5-4d227ef41862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:51.283153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615be9b-a18c-4ab8-a95c-873080a03347 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:51.283469 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615be9b-a18c-4ab8-a95c-873080a03347 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:51.283750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615be9b-a18c-4ab8-a95c-873080a03347 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:51.285088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 6/11] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:31:51.290117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3532eb-e927-443a-a1a6-addf34e86f0f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:51.290403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3532eb-e927-443a-a1a6-addf34e86f0f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:51.290683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3532eb-e927-443a-a1a6-addf34e86f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:51.331052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG passlib.handlers.bcrypt [None req-8f3532eb-e927-443a-a1a6-addf34e86f0f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87052) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 08:31:51.331508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG passlib.handlers.bcrypt [None req-8f3532eb-e927-443a-a1a6-addf34e86f0f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87052) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 08:31:51.354936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 6/12] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:31:51.377754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8f3532eb-e927-443a-a1a6-addf34e86f0f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:51.379047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65402d16-6991-4478-8ab5-4d227ef41862 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:51.379366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8f3532eb-e927-443a-a1a6-addf34e86f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:51.402363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:51.483395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 7/13] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:31:51.483595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65402d16-6991-4478-8ab5-4d227ef41862 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:51.502805 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3532eb-e927-443a-a1a6-addf34e86f0f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:51.519882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2493fb-2fd6-4aca-988e-e6028ce3cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:51.520681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2493fb-2fd6-4aca-988e-e6028ce3cf64 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:51.520970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2493fb-2fd6-4aca-988e-e6028ce3cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:51.521254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2493fb-2fd6-4aca-988e-e6028ce3cf64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:51.532623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2493fb-2fd6-4aca-988e-e6028ce3cf64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-cb2493fb-2fd6-4aca-988e-e6028ce3cf64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:31:51.543910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:31:51.545029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:31:51.546116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 7/14] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:31:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:31:51.551561 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2493fb-2fd6-4aca-988e-e6028ce3cf64 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:51.608760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3532eb-e927-443a-a1a6-addf34e86f0f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:51.612277 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:51.633646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:51.649987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179aee9-0a4f-48fa-8577-57a7498b0ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:51.650890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179aee9-0a4f-48fa-8577-57a7498b0ead None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:51.650983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2493fb-2fd6-4aca-988e-e6028ce3cf64 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:51.651180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179aee9-0a4f-48fa-8577-57a7498b0ead None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:51.651493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179aee9-0a4f-48fa-8577-57a7498b0ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:51.687113 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aae901-5585-453a-8b47-4edb8a01642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:51.687831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae901-5585-453a-8b47-4edb8a01642b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:51.688119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae901-5585-453a-8b47-4edb8a01642b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:51.688436 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae901-5585-453a-8b47-4edb8a01642b None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:51.689188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aae901-5585-453a-8b47-4edb8a01642b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:31:51.690129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aae901-5585-453a-8b47-4edb8a01642b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:51.690885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aae901-5585-453a-8b47-4edb8a01642b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:51.703095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 8/15] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:31:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:31:51.709546 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aae901-5585-453a-8b47-4edb8a01642b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:51.728051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179aee9-0a4f-48fa-8577-57a7498b0ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:51.729580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179aee9-0a4f-48fa-8577-57a7498b0ead None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:51.808743 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aae901-5585-453a-8b47-4edb8a01642b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:51.827783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 8/16] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:31:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:31:51.833443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179aee9-0a4f-48fa-8577-57a7498b0ead None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:51.836160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:51.842314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa69ecb-0f61-4930-bdc0-1408c8019352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:51.843185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69ecb-0f61-4930-bdc0-1408c8019352 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:51.843508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69ecb-0f61-4930-bdc0-1408c8019352 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:51.843878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69ecb-0f61-4930-bdc0-1408c8019352 None admin] PATH_INFO: `/v3/users/1449ff4f407540dd843ab2db406229f6` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:51.845524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa69ecb-0f61-4930-bdc0-1408c8019352 None admin] RBAC: Authorizing `identity:get_user(user_id=1449ff4f407540dd843ab2db406229f6)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:51.846974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa69ecb-0f61-4930-bdc0-1408c8019352 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:51.848806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 9/17] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:31:51 2022] GET /identity/v3/users/1449ff4f407540dd843ab2db406229f6 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:31:51.854069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa69ecb-0f61-4930-bdc0-1408c8019352 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:51.869181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:51.934075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179aee9-0a4f-48fa-8577-57a7498b0ead None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:51.957957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa69ecb-0f61-4930-bdc0-1408c8019352 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:51.968220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68a18b-42c7-4782-93cb-85c0e5aff34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:51.969012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68a18b-42c7-4782-93cb-85c0e5aff34b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:51.969296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68a18b-42c7-4782-93cb-85c0e5aff34b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:51.970124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68a18b-42c7-4782-93cb-85c0e5aff34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:51.989566 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68a18b-42c7-4782-93cb-85c0e5aff34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:51.991178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68a18b-42c7-4782-93cb-85c0e5aff34b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:51.991564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc02f3-0cd6-4cf2-a15e-55d546c63283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:51.992354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc02f3-0cd6-4cf2-a15e-55d546c63283 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:51.992633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc02f3-0cd6-4cf2-a15e-55d546c63283 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:51.992906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc02f3-0cd6-4cf2-a15e-55d546c63283 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:51.994103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc02f3-0cd6-4cf2-a15e-55d546c63283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:51.995546 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc02f3-0cd6-4cf2-a15e-55d546c63283 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:51.997131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 10/18] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:31:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:31:52.003054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc02f3-0cd6-4cf2-a15e-55d546c63283 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-5b68a18b-42c7-4782-93cb-85c0e5aff34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:31:52.012736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:31:52.013728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:31:52.014572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:31:52.014572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:31:52.014572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:31:52.014572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:31:52.014572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 9/19] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:31:52.020284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68a18b-42c7-4782-93cb-85c0e5aff34b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:52.079876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:52.085699 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:52.105403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc02f3-0cd6-4cf2-a15e-55d546c63283 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:52.125109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68a18b-42c7-4782-93cb-85c0e5aff34b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:52.139963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd860616-0cec-4d3c-b9f6-aa46585f90a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:52.140623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd860616-0cec-4d3c-b9f6-aa46585f90a1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:52.140905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd860616-0cec-4d3c-b9f6-aa46585f90a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:52.141186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd860616-0cec-4d3c-b9f6-aa46585f90a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:52.142537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd860616-0cec-4d3c-b9f6-aa46585f90a1 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.domain.id=default, user.id=1449ff4f407540dd843ab2db406229f6) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:31:52.142846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd860616-0cec-4d3c-b9f6-aa46585f90a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:52.144361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd860616-0cec-4d3c-b9f6-aa46585f90a1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:52.151213 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 11/20] 10.222.0.78 () {56 vars in 1322 bytes} [Fri Jun 17 08:31:52 2022] GET /identity/v3/role_assignments?user.id=1449ff4f407540dd843ab2db406229f6&scope.domain.id=default&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:31:52.158885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0542ad-9bd1-4153-b1b9-b5a5c60deaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:52.159603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0542ad-9bd1-4153-b1b9-b5a5c60deaa6 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:52.159889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0542ad-9bd1-4153-b1b9-b5a5c60deaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:52.160164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0542ad-9bd1-4153-b1b9-b5a5c60deaa6 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:52.160916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0542ad-9bd1-4153-b1b9-b5a5c60deaa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:31:52.161221 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0542ad-9bd1-4153-b1b9-b5a5c60deaa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:52.162668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0542ad-9bd1-4153-b1b9-b5a5c60deaa6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:52.183485 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 10/21] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:31:54.679262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c4e6b-c0b5-47c2-a742-eafae52e94a8 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:54.679818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c4e6b-c0b5-47c2-a742-eafae52e94a8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:54.679893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c4e6b-c0b5-47c2-a742-eafae52e94a8 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:54.681204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 12/22] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:54.693328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31273e65-3dcc-467c-90c1-62b46841eaff None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:54.693923 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31273e65-3dcc-467c-90c1-62b46841eaff None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:54.694438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31273e65-3dcc-467c-90c1-62b46841eaff None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:54.695954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 13/23] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:31:54.697400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3d186-9e22-4c1e-827e-3fc50822e374 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:54.698253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3d186-9e22-4c1e-827e-3fc50822e374 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:54.698735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3d186-9e22-4c1e-827e-3fc50822e374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:54.700815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6defdfa-9a9f-43ca-9107-f19a2a7d36e2 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:54.701569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6defdfa-9a9f-43ca-9107-f19a2a7d36e2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:54.702039 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6defdfa-9a9f-43ca-9107-f19a2a7d36e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:54.732363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f6defdfa-9a9f-43ca-9107-f19a2a7d36e2 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:54.734182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f6defdfa-9a9f-43ca-9107-f19a2a7d36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:54.738831 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-33b3d186-9e22-4c1e-827e-3fc50822e374 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:54.740067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-33b3d186-9e22-4c1e-827e-3fc50822e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:54.885664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 14/24] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:31:54.887085 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f7243-40c6-4cbb-a60e-11343b772300 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:54.887389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f7243-40c6-4cbb-a60e-11343b772300 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:54.887666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f7243-40c6-4cbb-a60e-11343b772300 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:54.888918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 15/25] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:54.897295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d886-e4d0-48fb-b8c5-46c2589429c8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:54.897578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d886-e4d0-48fb-b8c5-46c2589429c8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:54.897855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d886-e4d0-48fb-b8c5-46c2589429c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:54.920621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 11/26] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:31:54.925591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3d186-9e22-4c1e-827e-3fc50822e374 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:54.938767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-86f9d886-e4d0-48fb-b8c5-46c2589429c8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:54.940008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-86f9d886-e4d0-48fb-b8c5-46c2589429c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:55.003864 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:55.062607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3d186-9e22-4c1e-827e-3fc50822e374 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:55.085823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 16/27] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:31:55.086772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9d886-e4d0-48fb-b8c5-46c2589429c8 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:55.096540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:55.113782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc589a-bfd2-4d12-a0c8-f3a4dfc816b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:55.114605 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc589a-bfd2-4d12-a0c8-f3a4dfc816b7 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:55.114887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc589a-bfd2-4d12-a0c8-f3a4dfc816b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:55.115160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc589a-bfd2-4d12-a0c8-f3a4dfc816b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:55.131615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc589a-bfd2-4d12-a0c8-f3a4dfc816b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-21bc589a-bfd2-4d12-a0c8-f3a4dfc816b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:31:55.149385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:31:55.150305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:31:55.151039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 12/28] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:31:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:31:55.152274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc589a-bfd2-4d12-a0c8-f3a4dfc816b7 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:55.262760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc589a-bfd2-4d12-a0c8-f3a4dfc816b7 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:55.274936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:55.298059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583f48-7b25-4206-8dbe-796982a2713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:55.298846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583f48-7b25-4206-8dbe-796982a2713e None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:55.299134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583f48-7b25-4206-8dbe-796982a2713e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:55.299446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583f48-7b25-4206-8dbe-796982a2713e None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:55.300282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95583f48-7b25-4206-8dbe-796982a2713e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:55.301893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95583f48-7b25-4206-8dbe-796982a2713e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:55.352563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9d886-e4d0-48fb-b8c5-46c2589429c8 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:55.388987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b5039-66f4-4a45-8774-47ee8afe51ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:55.389786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b5039-66f4-4a45-8774-47ee8afe51ed None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:55.390115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b5039-66f4-4a45-8774-47ee8afe51ed None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:55.390396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b5039-66f4-4a45-8774-47ee8afe51ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:55.403414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b5039-66f4-4a45-8774-47ee8afe51ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:55.405131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b5039-66f4-4a45-8774-47ee8afe51ed None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-341b5039-66f4-4a45-8774-47ee8afe51ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:31:55.426025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:31:55.427541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:31:55.429122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:31:55.429122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:31:55.429122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:31:55.429122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:31:55.429122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 17/29] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:31:55.429122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b5039-66f4-4a45-8774-47ee8afe51ed None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:55.560892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:55.608560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 13/30] 10.222.0.78 () {60 vars in 1131 bytes} [Fri Jun 17 08:31:55 2022] POST /identity/v3/roles => generated 219 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:31:55.609737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583f48-7b25-4206-8dbe-796982a2713e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:55.676412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b5039-66f4-4a45-8774-47ee8afe51ed None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:55.732477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583f48-7b25-4206-8dbe-796982a2713e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:55.737482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f633891-4699-4451-bfb5-834d48f37641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:55.738374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f633891-4699-4451-bfb5-834d48f37641 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:55.738746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f633891-4699-4451-bfb5-834d48f37641 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:55.739033 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f633891-4699-4451-bfb5-834d48f37641 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:55.739859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f633891-4699-4451-bfb5-834d48f37641 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:31:55.740170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f633891-4699-4451-bfb5-834d48f37641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:55.741577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f633891-4699-4451-bfb5-834d48f37641 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:55.761729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 18/31] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:31:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:31:55.762907 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8a273-2b36-4289-b7b4-f4d5b16480c8 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:55.763196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8a273-2b36-4289-b7b4-f4d5b16480c8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:55.767675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8a273-2b36-4289-b7b4-f4d5b16480c8 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:55.769235 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 19/32] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:55.769869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8a273-2b36-4289-b7b4-f4d5b16480c8 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:55.772656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b354e99-d91d-4978-a94e-9e3cc80b1865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:55.773337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354e99-d91d-4978-a94e-9e3cc80b1865 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:55.773624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354e99-d91d-4978-a94e-9e3cc80b1865 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:55.773904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354e99-d91d-4978-a94e-9e3cc80b1865 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:55.774703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b354e99-d91d-4978-a94e-9e3cc80b1865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:31:55.775014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b354e99-d91d-4978-a94e-9e3cc80b1865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:55.776764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b354e99-d91d-4978-a94e-9e3cc80b1865 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:55.790160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 14/33] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:31:55.791620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c17be-2a6a-4335-bf7f-2652f9b65d31 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:55.791917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c17be-2a6a-4335-bf7f-2652f9b65d31 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:55.792194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c17be-2a6a-4335-bf7f-2652f9b65d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:55.929371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-986c17be-2a6a-4335-bf7f-2652f9b65d31 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:55.930879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-986c17be-2a6a-4335-bf7f-2652f9b65d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:55.958153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:55.965187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8a273-2b36-4289-b7b4-f4d5b16480c8 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:55.992012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:56.012842 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 15/34] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:31:56.013504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c17be-2a6a-4335-bf7f-2652f9b65d31 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:56.024120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6ae34-071e-4773-a943-fd5e89e0c520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:56.025411 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6ae34-071e-4773-a943-fd5e89e0c520 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:56.025871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6ae34-071e-4773-a943-fd5e89e0c520 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:56.026341 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6ae34-071e-4773-a943-fd5e89e0c520 None admin] PATH_INFO: `/v3/users/1449ff4f407540dd843ab2db406229f6` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:56.027882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6ae34-071e-4773-a943-fd5e89e0c520 None admin] RBAC: Authorizing `identity:get_user(user_id=1449ff4f407540dd843ab2db406229f6)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:56.029578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6ae34-071e-4773-a943-fd5e89e0c520 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:56.031632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 20/35] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:31:55 2022] GET /identity/v3/users/1449ff4f407540dd843ab2db406229f6 => generated 247 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:31:56.040668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6ae34-071e-4773-a943-fd5e89e0c520 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:56.148173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c17be-2a6a-4335-bf7f-2652f9b65d31 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:56.179066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6ae34-071e-4773-a943-fd5e89e0c520 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:56.190211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24257c9-325c-425d-a698-883565ac9409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:56.191073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24257c9-325c-425d-a698-883565ac9409 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:56.191561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24257c9-325c-425d-a698-883565ac9409 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:56.191850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24257c9-325c-425d-a698-883565ac9409 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:56.192824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24257c9-325c-425d-a698-883565ac9409 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:56.194312 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24257c9-325c-425d-a698-883565ac9409 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:56.218846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7d5b8-a691-4d64-8d04-19a50b0cc8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:56.219751 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d5b8-a691-4d64-8d04-19a50b0cc8b4 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:56.219999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d5b8-a691-4d64-8d04-19a50b0cc8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:56.220271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d5b8-a691-4d64-8d04-19a50b0cc8b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:56.221433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7d5b8-a691-4d64-8d04-19a50b0cc8b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:56.222883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7d5b8-a691-4d64-8d04-19a50b0cc8b4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:56.224546 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 21/36] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:31:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:31:56.225254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7d5b8-a691-4d64-8d04-19a50b0cc8b4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:56.279367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:56.304672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 16/37] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:31:56 2022] POST /identity/v3/projects => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:31:56.315535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfe66e-9033-4692-8bb2-f68a63f05092 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:56.315897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfe66e-9033-4692-8bb2-f68a63f05092 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:56.316538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfe66e-9033-4692-8bb2-f68a63f05092 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:56.318672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 17/38] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:56 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:56.320647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33c67b-328c-43f0-80f5-009ec1f19f10 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:56.321109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33c67b-328c-43f0-80f5-009ec1f19f10 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:56.321570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33c67b-328c-43f0-80f5-009ec1f19f10 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:56.323846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 18/39] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:56.325517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33c67b-328c-43f0-80f5-009ec1f19f10 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:56.330066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7d5b8-a691-4d64-8d04-19a50b0cc8b4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:56.341127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:56.371242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999d890-2a5e-46f0-a3fa-1c5378ee4b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:56.371949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999d890-2a5e-46f0-a3fa-1c5378ee4b43 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:56.372233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999d890-2a5e-46f0-a3fa-1c5378ee4b43 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:56.372576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999d890-2a5e-46f0-a3fa-1c5378ee4b43 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:56.373340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999d890-2a5e-46f0-a3fa-1c5378ee4b43 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:56.374869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999d890-2a5e-46f0-a3fa-1c5378ee4b43 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:56.440953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33c67b-328c-43f0-80f5-009ec1f19f10 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:56.484418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25725d7-6bd7-40ae-b949-9e87fc2decd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:56.486736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25725d7-6bd7-40ae-b949-9e87fc2decd0 None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:56.486736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25725d7-6bd7-40ae-b949-9e87fc2decd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:56.486736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25725d7-6bd7-40ae-b949-9e87fc2decd0 None admin] PATH_INFO: `/v3/domains/default/users/1449ff4f407540dd843ab2db406229f6/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:56.491400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25725d7-6bd7-40ae-b949-9e87fc2decd0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1449ff4f407540dd843ab2db406229f6, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:56.491400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25725d7-6bd7-40ae-b949-9e87fc2decd0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:56.581391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 19/40] 10.222.0.78 () {58 vars in 1361 bytes} [Fri Jun 17 08:31:56 2022] PUT /identity/v3/domains/default/users/1449ff4f407540dd843ab2db406229f6/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:31:56.582908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c22cab-23d8-4398-9b92-24c00a849e0f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:56.583208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c22cab-23d8-4398-9b92-24c00a849e0f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:56.583518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c22cab-23d8-4398-9b92-24c00a849e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:56.602140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d9c22cab-23d8-4398-9b92-24c00a849e0f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:56.603528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d9c22cab-23d8-4398-9b92-24c00a849e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:56.681712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:56.684453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 22/41] 10.222.0.78 () {60 vars in 1131 bytes} [Fri Jun 17 08:31:56 2022] POST /identity/v3/roles => generated 225 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:31:56.690511 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 20/42] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:31:56.702939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1bec2-41ce-45f5-9182-d41f0e1592d2 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:56.702939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1bec2-41ce-45f5-9182-d41f0e1592d2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:56.702939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1bec2-41ce-45f5-9182-d41f0e1592d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:56.715612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c22cab-23d8-4398-9b92-24c00a849e0f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:56.726894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-79f1bec2-41ce-45f5-9182-d41f0e1592d2 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:56.728694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-79f1bec2-41ce-45f5-9182-d41f0e1592d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:56.825243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 23/43] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:31:56.854737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1bec2-41ce-45f5-9182-d41f0e1592d2 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:56.869387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c22cab-23d8-4398-9b92-24c00a849e0f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:56.910051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4f3a3-b4d7-4042-9e7c-4a75ee72b08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:56.910245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:56.910322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4f3a3-b4d7-4042-9e7c-4a75ee72b08b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:56.910322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4f3a3-b4d7-4042-9e7c-4a75ee72b08b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:56.910322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4f3a3-b4d7-4042-9e7c-4a75ee72b08b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:56.910322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4f3a3-b4d7-4042-9e7c-4a75ee72b08b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:56.911523 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4f3a3-b4d7-4042-9e7c-4a75ee72b08b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:56.913326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 21/44] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:31:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:31:56.919728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4f3a3-b4d7-4042-9e7c-4a75ee72b08b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:56.980783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1bec2-41ce-45f5-9182-d41f0e1592d2 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:56.994759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:57.017754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3b78-9ed3-49d6-8d50-41ca559a2aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:57.018426 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3b78-9ed3-49d6-8d50-41ca559a2aec None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:57.018711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3b78-9ed3-49d6-8d50-41ca559a2aec None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:57.018992 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3b78-9ed3-49d6-8d50-41ca559a2aec None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:57.019814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f3b78-9ed3-49d6-8d50-41ca559a2aec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:57.021490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f3b78-9ed3-49d6-8d50-41ca559a2aec None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:57.032329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4f3a3-b4d7-4042-9e7c-4a75ee72b08b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:57.067855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ae45d-989b-4b89-8d12-8b21b6da736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:57.068520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae45d-989b-4b89-8d12-8b21b6da736f None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:57.068817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae45d-989b-4b89-8d12-8b21b6da736f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:57.069092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae45d-989b-4b89-8d12-8b21b6da736f None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:57.069807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ae45d-989b-4b89-8d12-8b21b6da736f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:57.071248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ae45d-989b-4b89-8d12-8b21b6da736f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:57.127770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 24/45] 10.222.0.78 () {60 vars in 1131 bytes} [Fri Jun 17 08:31:56 2022] POST /identity/v3/roles => generated 223 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:31:57.163382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 22/46] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:31:56 2022] POST /identity/v3/projects => generated 312 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:31:58.756372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc3de0-6dda-47ee-a9e4-4000f0e1e875 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:58.757049 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc3de0-6dda-47ee-a9e4-4000f0e1e875 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:58.757344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc3de0-6dda-47ee-a9e4-4000f0e1e875 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:58.758721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 25/47] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:58.763917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca84f-7c15-49dd-902e-181001e74915 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:58.764353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca84f-7c15-49dd-902e-181001e74915 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:58.764614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ca84f-7c15-49dd-902e-181001e74915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:58.781228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b69ca84f-7c15-49dd-902e-181001e74915 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:58.782473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b69ca84f-7c15-49dd-902e-181001e74915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:58.850821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 23/48] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:31:58.873428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc3de0-6dda-47ee-a9e4-4000f0e1e875 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:58.974110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc3de0-6dda-47ee-a9e4-4000f0e1e875 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:58.976654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:59.008476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe1abb-774b-4cff-bb7a-af747bb4c29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:59.009188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe1abb-774b-4cff-bb7a-af747bb4c29f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:59.009475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe1abb-774b-4cff-bb7a-af747bb4c29f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:59.009756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe1abb-774b-4cff-bb7a-af747bb4c29f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:59.020757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe1abb-774b-4cff-bb7a-af747bb4c29f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-4bfe1abb-774b-4cff-bb7a-af747bb4c29f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:31:59.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:31:59.029635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:31:59.030422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 26/49] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:31:59.035917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ca84f-7c15-49dd-902e-181001e74915 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:59.086301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:59.137071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ca84f-7c15-49dd-902e-181001e74915 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:59.174024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ece05-332c-469f-8f3f-2d22ace38f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:59.174695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ece05-332c-469f-8f3f-2d22ace38f26 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:59.174999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ece05-332c-469f-8f3f-2d22ace38f26 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:59.175278 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ece05-332c-469f-8f3f-2d22ace38f26 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:59.176051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ece05-332c-469f-8f3f-2d22ace38f26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:31:59.176362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ece05-332c-469f-8f3f-2d22ace38f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:59.177791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ece05-332c-469f-8f3f-2d22ace38f26 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:59.189528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 24/50] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:31:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:31:59.195048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe1abb-774b-4cff-bb7a-af747bb4c29f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:59.292279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69f9c0-acef-4bf9-8101-df96ef8f793c None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:59.292473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69f9c0-acef-4bf9-8101-df96ef8f793c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:59.292743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69f9c0-acef-4bf9-8101-df96ef8f793c None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:59.294112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 25/51] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:31:59.299594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cfa50-4ea1-4c5a-9076-3fb31b9de5e4 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:59.299882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cfa50-4ea1-4c5a-9076-3fb31b9de5e4 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:59.300158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cfa50-4ea1-4c5a-9076-3fb31b9de5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:59.302085 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe1abb-774b-4cff-bb7a-af747bb4c29f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:59.316835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f38cfa50-4ea1-4c5a-9076-3fb31b9de5e4 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:31:59.318018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f38cfa50-4ea1-4c5a-9076-3fb31b9de5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:31:59.337295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6c11f-cb72-40f7-a3c5-a63b45d25f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:59.338172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6c11f-cb72-40f7-a3c5-a63b45d25f48 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:59.338458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6c11f-cb72-40f7-a3c5-a63b45d25f48 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:59.338738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6c11f-cb72-40f7-a3c5-a63b45d25f48 None admin] PATH_INFO: `/v3/users/1449ff4f407540dd843ab2db406229f6` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:59.339952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6c11f-cb72-40f7-a3c5-a63b45d25f48 None admin] RBAC: Authorizing `identity:get_user(user_id=1449ff4f407540dd843ab2db406229f6)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:59.341412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6c11f-cb72-40f7-a3c5-a63b45d25f48 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:59.343239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 27/52] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:31:59 2022] GET /identity/v3/users/1449ff4f407540dd843ab2db406229f6 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:31:59.349083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6c11f-cb72-40f7-a3c5-a63b45d25f48 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:59.380384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:59.388033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 26/53] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:31:59.411510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cfa50-4ea1-4c5a-9076-3fb31b9de5e4 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:59.456108 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6c11f-cb72-40f7-a3c5-a63b45d25f48 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:59.459310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:59.490650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f3321-5d86-42af-869a-c04e783bdd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:59.491481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f3321-5d86-42af-869a-c04e783bdd0d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:59.491765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f3321-5d86-42af-869a-c04e783bdd0d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:59.492041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f3321-5d86-42af-869a-c04e783bdd0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:59.493275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f3321-5d86-42af-869a-c04e783bdd0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:59.494663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f3321-5d86-42af-869a-c04e783bdd0d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:59.496312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 28/54] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:31:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:31:59.502216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f3321-5d86-42af-869a-c04e783bdd0d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:59.527652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cfa50-4ea1-4c5a-9076-3fb31b9de5e4 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:59.562381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431322f-177b-483e-ba13-0f3dee9d69e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:59.563219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431322f-177b-483e-ba13-0f3dee9d69e3 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:59.563541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431322f-177b-483e-ba13-0f3dee9d69e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:59.563821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431322f-177b-483e-ba13-0f3dee9d69e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:59.565494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431322f-177b-483e-ba13-0f3dee9d69e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:59.566968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431322f-177b-483e-ba13-0f3dee9d69e3 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:59.568816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:31:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:31:59.574203 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431322f-177b-483e-ba13-0f3dee9d69e3 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:31:59.603890 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:59.607032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f3321-5d86-42af-869a-c04e783bdd0d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:59.640419 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd78a5b-67f9-4c97-82d2-e6a28b3b4d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:59.641568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd78a5b-67f9-4c97-82d2-e6a28b3b4d99 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:59.641864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd78a5b-67f9-4c97-82d2-e6a28b3b4d99 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:59.642142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd78a5b-67f9-4c97-82d2-e6a28b3b4d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:59.642971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd78a5b-67f9-4c97-82d2-e6a28b3b4d99 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.domain.id=default, user.id=1449ff4f407540dd843ab2db406229f6) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:31:59.643283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd78a5b-67f9-4c97-82d2-e6a28b3b4d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:59.644759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd78a5b-67f9-4c97-82d2-e6a28b3b4d99 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:59.650897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 29/56] 10.222.0.78 () {56 vars in 1322 bytes} [Fri Jun 17 08:31:59 2022] GET /identity/v3/role_assignments?user.id=1449ff4f407540dd843ab2db406229f6&scope.domain.id=default&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:31:59.678427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431322f-177b-483e-ba13-0f3dee9d69e3 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:31:59.689399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:31:59.715946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8937164-b795-4b53-acb0-154c073869f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:31:59.716621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8937164-b795-4b53-acb0-154c073869f7 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:31:59.716915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8937164-b795-4b53-acb0-154c073869f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:31:59.717206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8937164-b795-4b53-acb0-154c073869f7 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:31:59.717936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8937164-b795-4b53-acb0-154c073869f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:31:59.720045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8937164-b795-4b53-acb0-154c073869f7 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:31:59.834649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 28/57] 10.222.0.78 () {60 vars in 1140 bytes} [Fri Jun 17 08:31:59 2022] POST /identity/v3/projects => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:32:01.952487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec11ac8-dc1a-4757-8a64-97d967d6c9a5 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:01.953059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec11ac8-dc1a-4757-8a64-97d967d6c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:01.953059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec11ac8-dc1a-4757-8a64-97d967d6c9a5 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:01.955025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 30/58] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:01.960356 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad7da2-bf9f-4b05-b210-a40ca9e6b75e None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:01.960753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad7da2-bf9f-4b05-b210-a40ca9e6b75e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:01.960922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad7da2-bf9f-4b05-b210-a40ca9e6b75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:01.979094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-dfad7da2-bf9f-4b05-b210-a40ca9e6b75e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:01.980365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-dfad7da2-bf9f-4b05-b210-a40ca9e6b75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:02.045355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 29/59] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:02.070042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec11ac8-dc1a-4757-8a64-97d967d6c9a5 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:02.170841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec11ac8-dc1a-4757-8a64-97d967d6c9a5 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:02.204264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318ff42-5030-4b48-959f-91359ed427cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:02.204983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318ff42-5030-4b48-959f-91359ed427cb None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:02.205271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318ff42-5030-4b48-959f-91359ed427cb None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:02.205558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318ff42-5030-4b48-959f-91359ed427cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:02.206734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318ff42-5030-4b48-959f-91359ed427cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:02.208217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318ff42-5030-4b48-959f-91359ed427cb None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:02.209846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 31/60] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:32:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:02.215564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad7da2-bf9f-4b05-b210-a40ca9e6b75e None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:02.304059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:02.313210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad7da2-bf9f-4b05-b210-a40ca9e6b75e None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:02.347066 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0d0d6-a4eb-4bbb-bc79-9bf8c5cf5881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:02.347770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0d0d6-a4eb-4bbb-bc79-9bf8c5cf5881 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:02.348056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0d0d6-a4eb-4bbb-bc79-9bf8c5cf5881 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:02.348333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0d0d6-a4eb-4bbb-bc79-9bf8c5cf5881 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:02.349043 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0d0d6-a4eb-4bbb-bc79-9bf8c5cf5881 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:02.350558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0d0d6-a4eb-4bbb-bc79-9bf8c5cf5881 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:02.466532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 30/61] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:32:02 2022] POST /identity/v3/users => generated 275 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:32:05.696829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45da4c-2a07-4e26-be14-29f00dd92ea3 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:05.697783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45da4c-2a07-4e26-be14-29f00dd92ea3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:05.698220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45da4c-2a07-4e26-be14-29f00dd92ea3 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:05.699884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 32/62] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:05.720793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cabcdb-792c-44d0-9f21-ab7f4f1c870c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:05.721760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cabcdb-792c-44d0-9f21-ab7f4f1c870c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:05.722202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cabcdb-792c-44d0-9f21-ab7f4f1c870c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:05.748467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-09cabcdb-792c-44d0-9f21-ab7f4f1c870c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:05.749697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-09cabcdb-792c-44d0-9f21-ab7f4f1c870c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:05.778383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb5de-4423-46c8-97b9-fff15ebf6e9e None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:05.779065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb5de-4423-46c8-97b9-fff15ebf6e9e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:05.779565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abb5de-4423-46c8-97b9-fff15ebf6e9e None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:05.781140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 33/63] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:32:05.788640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec5701-dc4a-4448-b0fb-47f9c2d9cf6f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:05.789190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec5701-dc4a-4448-b0fb-47f9c2d9cf6f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:05.789685 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec5701-dc4a-4448-b0fb-47f9c2d9cf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:05.817856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-7eec5701-dc4a-4448-b0fb-47f9c2d9cf6f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:05.819402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7eec5701-dc4a-4448-b0fb-47f9c2d9cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:05.841264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 31/64] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:05.867094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cabcdb-792c-44d0-9f21-ab7f4f1c870c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:05.876381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:05.954654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:05.963163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 34/65] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:05.979628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cabcdb-792c-44d0-9f21-ab7f4f1c870c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:05.998545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec5701-dc4a-4448-b0fb-47f9c2d9cf6f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:06.019677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacc652-99f9-4a9e-b20f-858ffaa5dd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:06.020758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacc652-99f9-4a9e-b20f-858ffaa5dd43 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.021520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacc652-99f9-4a9e-b20f-858ffaa5dd43 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.022147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacc652-99f9-4a9e-b20f-858ffaa5dd43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.033668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacc652-99f9-4a9e-b20f-858ffaa5dd43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-0cacc652-99f9-4a9e-b20f-858ffaa5dd43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:06.042494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:06.043564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:06.044528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:06.047100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 32/66] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:06.053434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacc652-99f9-4a9e-b20f-858ffaa5dd43 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:06.172489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacc652-99f9-4a9e-b20f-858ffaa5dd43 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:06.217243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988123-93cd-4935-95b7-54c08ea747c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:06.218294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988123-93cd-4935-95b7-54c08ea747c2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.218733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988123-93cd-4935-95b7-54c08ea747c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.219202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988123-93cd-4935-95b7-54c08ea747c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.220520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988123-93cd-4935-95b7-54c08ea747c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:06.221612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988123-93cd-4935-95b7-54c08ea747c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:06.223581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988123-93cd-4935-95b7-54c08ea747c2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:06.227263 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:06.237706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 33/67] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:06.240197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068ad25-204b-4c2f-8053-87eb43dfa33f None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.240701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068ad25-204b-4c2f-8053-87eb43dfa33f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.241583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068ad25-204b-4c2f-8053-87eb43dfa33f None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.242886 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 34/68] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:06.247810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068ad25-204b-4c2f-8053-87eb43dfa33f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:06.252355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec5701-dc4a-4448-b0fb-47f9c2d9cf6f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:06.296999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62523525-4fda-45db-b7a0-8dd942b67fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:06.298997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62523525-4fda-45db-b7a0-8dd942b67fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.299475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62523525-4fda-45db-b7a0-8dd942b67fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.299916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62523525-4fda-45db-b7a0-8dd942b67fb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.317496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62523525-4fda-45db-b7a0-8dd942b67fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-62523525-4fda-45db-b7a0-8dd942b67fb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:06.326489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:06.327556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:06.328681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:06.329781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 35/69] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:06.331132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6dd9-8f35-4dcd-9b63-781c2e80c8f1 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.331503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6dd9-8f35-4dcd-9b63-781c2e80c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.331792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6dd9-8f35-4dcd-9b63-781c2e80c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.353751 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-985c6dd9-8f35-4dcd-9b63-781c2e80c8f1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:06.355076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-985c6dd9-8f35-4dcd-9b63-781c2e80c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:06.374805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:06.374970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068ad25-204b-4c2f-8053-87eb43dfa33f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:06.422769 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb99e9-7530-49a8-86cf-38c5ddb6d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:06.423990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb99e9-7530-49a8-86cf-38c5ddb6d9ff None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.424439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb99e9-7530-49a8-86cf-38c5ddb6d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.424788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb99e9-7530-49a8-86cf-38c5ddb6d9ff None admin] PATH_INFO: `/v3/users/1449ff4f407540dd843ab2db406229f6` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.426759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb99e9-7530-49a8-86cf-38c5ddb6d9ff None admin] RBAC: Authorizing `identity:get_user(user_id=1449ff4f407540dd843ab2db406229f6)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:06.428838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb99e9-7530-49a8-86cf-38c5ddb6d9ff None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:06.435496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 35/70] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:06 2022] GET /identity/v3/users/1449ff4f407540dd843ab2db406229f6 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:06.435496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c64b67-abe0-4fbf-a018-354d98ee25b5 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.435496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c64b67-abe0-4fbf-a018-354d98ee25b5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.435496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c64b67-abe0-4fbf-a018-354d98ee25b5 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.435496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 36/71] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:06.437740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 36/72] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:06.443141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c64b67-abe0-4fbf-a018-354d98ee25b5 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:06.443962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c6dd9-8f35-4dcd-9b63-781c2e80c8f1 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:06.542723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:06.593200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c64b67-abe0-4fbf-a018-354d98ee25b5 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:06.602756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c6dd9-8f35-4dcd-9b63-781c2e80c8f1 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:06.630830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e990c89-de02-45a6-9f97-9fda39769233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:06.631552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990c89-de02-45a6-9f97-9fda39769233 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.631842 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990c89-de02-45a6-9f97-9fda39769233 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.632124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e990c89-de02-45a6-9f97-9fda39769233 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.632872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e990c89-de02-45a6-9f97-9fda39769233 None admin] RBAC: Adding query filter params (name=member) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:06.633193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e990c89-de02-45a6-9f97-9fda39769233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:06.634589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e990c89-de02-45a6-9f97-9fda39769233 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:06.642476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7d386-9ae6-490e-a66d-c590521c701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:06.643137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d386-9ae6-490e-a66d-c590521c701a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.643469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d386-9ae6-490e-a66d-c590521c701a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.643754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d386-9ae6-490e-a66d-c590521c701a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.649414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 37/73] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:06.649414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12924-ef5f-4183-9b50-ab778294968b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.649414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12924-ef5f-4183-9b50-ab778294968b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.649414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12924-ef5f-4183-9b50-ab778294968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.664734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-16d12924-ef5f-4183-9b50-ab778294968b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:06.665950 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-16d12924-ef5f-4183-9b50-ab778294968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:06.671987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:06.725293 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7d386-9ae6-490e-a66d-c590521c701a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:06.726793 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7d386-9ae6-490e-a66d-c590521c701a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:06.754303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 38/74] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:06.755729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d12924-ef5f-4183-9b50-ab778294968b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:06.815732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:06.839752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 37/75] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:06.841407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761909ab-b381-4f70-a513-6bcdb11f1115 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.841704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761909ab-b381-4f70-a513-6bcdb11f1115 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.841990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761909ab-b381-4f70-a513-6bcdb11f1115 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.843266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 38/76] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:06.844596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761909ab-b381-4f70-a513-6bcdb11f1115 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:06.864197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d12924-ef5f-4183-9b50-ab778294968b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:06.898300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415bf6c-388e-4bda-8a7b-ece753105674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:06.898851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:06.899112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bf6c-388e-4bda-8a7b-ece753105674 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.899436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bf6c-388e-4bda-8a7b-ece753105674 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.899717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415bf6c-388e-4bda-8a7b-ece753105674 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.910554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415bf6c-388e-4bda-8a7b-ece753105674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-4415bf6c-388e-4bda-8a7b-ece753105674 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:06.918773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:06.919945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:06.920725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 39/77] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:06.921772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415bf6c-388e-4bda-8a7b-ece753105674 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:06.949210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761909ab-b381-4f70-a513-6bcdb11f1115 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:06.983535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca0501-07ee-45bd-99b7-07560ba1c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:06.984664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca0501-07ee-45bd-99b7-07560ba1c102 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:06.984956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca0501-07ee-45bd-99b7-07560ba1c102 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:06.985230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca0501-07ee-45bd-99b7-07560ba1c102 None admin] PATH_INFO: `/v3/users/d9586b808f424d84881b2efb78ae761f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:06.998666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca0501-07ee-45bd-99b7-07560ba1c102 None admin] RBAC: Authorizing `identity:get_user(user_id=d9586b808f424d84881b2efb78ae761f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.000164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca0501-07ee-45bd-99b7-07560ba1c102 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:07.002393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 39/78] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:06 2022] GET /identity/v3/users/d9586b808f424d84881b2efb78ae761f => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:07.003172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca0501-07ee-45bd-99b7-07560ba1c102 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.026274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415bf6c-388e-4bda-8a7b-ece753105674 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.043308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:07.060854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219948-2d60-413f-b8c2-be5e36e65824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.061718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219948-2d60-413f-b8c2-be5e36e65824 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.062015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219948-2d60-413f-b8c2-be5e36e65824 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.062304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219948-2d60-413f-b8c2-be5e36e65824 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.073191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219948-2d60-413f-b8c2-be5e36e65824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-e8219948-2d60-413f-b8c2-be5e36e65824 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:07.081616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:07.082493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:07.083257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 40/79] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:07.084109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a80b64-3d30-4867-9cdd-47d996a29122 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.084394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a80b64-3d30-4867-9cdd-47d996a29122 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.084668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a80b64-3d30-4867-9cdd-47d996a29122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.102860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca0501-07ee-45bd-99b7-07560ba1c102 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.104382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c5a80b64-3d30-4867-9cdd-47d996a29122 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:07.105586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c5a80b64-3d30-4867-9cdd-47d996a29122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:07.113648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:07.135857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f61c7-9e77-472f-a996-5149b4fa4a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.136715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f61c7-9e77-472f-a996-5149b4fa4a46 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.137001 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f61c7-9e77-472f-a996-5149b4fa4a46 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.137276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f61c7-9e77-472f-a996-5149b4fa4a46 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.138465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f61c7-9e77-472f-a996-5149b4fa4a46 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.139952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f61c7-9e77-472f-a996-5149b4fa4a46 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:07.142426 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 40/80] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:07 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:07.143198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f61c7-9e77-472f-a996-5149b4fa4a46 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.174094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 41/81] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:07.174948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a80b64-3d30-4867-9cdd-47d996a29122 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.244395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f61c7-9e77-472f-a996-5149b4fa4a46 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.278666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d3454-e655-4659-8c46-fac2b6cbd4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.279327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d3454-e655-4659-8c46-fac2b6cbd4c0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.279651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d3454-e655-4659-8c46-fac2b6cbd4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.279934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d3454-e655-4659-8c46-fac2b6cbd4c0 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.280662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d3454-e655-4659-8c46-fac2b6cbd4c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:07.280968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d3454-e655-4659-8c46-fac2b6cbd4c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.282905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d3454-e655-4659-8c46-fac2b6cbd4c0 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:07.284353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a80b64-3d30-4867-9cdd-47d996a29122 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.291074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 41/82] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:07.291891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d3454-e655-4659-8c46-fac2b6cbd4c0 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.294299 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:07.320685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d32e6-e5ad-4fb2-a1ce-5fde86dd87c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.321342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d32e6-e5ad-4fb2-a1ce-5fde86dd87c5 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.321633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d32e6-e5ad-4fb2-a1ce-5fde86dd87c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.321919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d32e6-e5ad-4fb2-a1ce-5fde86dd87c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.335290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:07.392686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d32e6-e5ad-4fb2-a1ce-5fde86dd87c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.394168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d32e6-e5ad-4fb2-a1ce-5fde86dd87c5 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:07.394536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d3454-e655-4659-8c46-fac2b6cbd4c0 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.428542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27602e17-6b3c-4bcb-b799-655c101a2c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.429217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27602e17-6b3c-4bcb-b799-655c101a2c1e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.429512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27602e17-6b3c-4bcb-b799-655c101a2c1e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.429800 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27602e17-6b3c-4bcb-b799-655c101a2c1e None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.430632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27602e17-6b3c-4bcb-b799-655c101a2c1e None admin] RBAC: Adding query filter params (name=member) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:07.430953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27602e17-6b3c-4bcb-b799-655c101a2c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.432378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27602e17-6b3c-4bcb-b799-655c101a2c1e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:07.441562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 42/83] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:07.442447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27602e17-6b3c-4bcb-b799-655c101a2c1e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.499220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 42/84] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:07.500098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d32e6-e5ad-4fb2-a1ce-5fde86dd87c5 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.510602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:07.550865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27602e17-6b3c-4bcb-b799-655c101a2c1e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.552406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:07.587174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a22106-8dd1-4d1c-9d4b-1f23c6fc2a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.587774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a22106-8dd1-4d1c-9d4b-1f23c6fc2a33 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.588056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a22106-8dd1-4d1c-9d4b-1f23c6fc2a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.588333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a22106-8dd1-4d1c-9d4b-1f23c6fc2a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.589162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a22106-8dd1-4d1c-9d4b-1f23c6fc2a33 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=82e4708d10bd4a56b8c263303c8beb29, user.id=1449ff4f407540dd843ab2db406229f6) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:07.589474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a22106-8dd1-4d1c-9d4b-1f23c6fc2a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.590919 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a22106-8dd1-4d1c-9d4b-1f23c6fc2a33 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:07.596654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 43/85] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:07 2022] GET /identity/v3/role_assignments?user.id=1449ff4f407540dd843ab2db406229f6&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:07.597411 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a22106-8dd1-4d1c-9d4b-1f23c6fc2a33 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.609133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d32e6-e5ad-4fb2-a1ce-5fde86dd87c5 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.649671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2b427-ebba-4e4c-965c-d797eff3dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.650602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2b427-ebba-4e4c-965c-d797eff3dc67 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.650891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2b427-ebba-4e4c-965c-d797eff3dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.651170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2b427-ebba-4e4c-965c-d797eff3dc67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.652629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2b427-ebba-4e4c-965c-d797eff3dc67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.654137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2b427-ebba-4e4c-965c-d797eff3dc67 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:07.656145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 43/86] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:32:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:07.657268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2b427-ebba-4e4c-965c-d797eff3dc67 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.727555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a22106-8dd1-4d1c-9d4b-1f23c6fc2a33 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.752572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:07.770021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaba9ed-cc72-4131-8f9f-2c049bd01d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.770899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaba9ed-cc72-4131-8f9f-2c049bd01d8e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.771185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaba9ed-cc72-4131-8f9f-2c049bd01d8e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.771488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaba9ed-cc72-4131-8f9f-2c049bd01d8e None admin] PATH_INFO: `/v3/users/d9586b808f424d84881b2efb78ae761f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.772717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaba9ed-cc72-4131-8f9f-2c049bd01d8e None admin] RBAC: Authorizing `identity:get_user(user_id=d9586b808f424d84881b2efb78ae761f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.774160 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaba9ed-cc72-4131-8f9f-2c049bd01d8e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:07.782215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 44/87] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:07 2022] GET /identity/v3/users/d9586b808f424d84881b2efb78ae761f => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:07.782215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaba9ed-cc72-4131-8f9f-2c049bd01d8e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.782563 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2b427-ebba-4e4c-965c-d797eff3dc67 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.816162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:07.821835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44718c-39b6-4df2-ac40-529adfdeb69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.822913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44718c-39b6-4df2-ac40-529adfdeb69f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.823396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44718c-39b6-4df2-ac40-529adfdeb69f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.823871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44718c-39b6-4df2-ac40-529adfdeb69f None admin] PATH_INFO: `/v3/users/d9586b808f424d84881b2efb78ae761f` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.829724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44718c-39b6-4df2-ac40-529adfdeb69f None admin] RBAC: Authorizing `identity:get_user(user_id=d9586b808f424d84881b2efb78ae761f)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.829724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44718c-39b6-4df2-ac40-529adfdeb69f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:07.829724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 44/88] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:07 2022] GET /identity/v3/users/d9586b808f424d84881b2efb78ae761f => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:07.829968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44718c-39b6-4df2-ac40-529adfdeb69f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.899982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaba9ed-cc72-4131-8f9f-2c049bd01d8e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.935098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44718c-39b6-4df2-ac40-529adfdeb69f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:07.936673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b261c6f-644d-4135-af58-2959a77ce6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.937539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b261c6f-644d-4135-af58-2959a77ce6b6 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.937923 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b261c6f-644d-4135-af58-2959a77ce6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.938214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b261c6f-644d-4135-af58-2959a77ce6b6 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.939581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b261c6f-644d-4135-af58-2959a77ce6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.941127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b261c6f-644d-4135-af58-2959a77ce6b6 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:07.942913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 45/89] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:07 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:07.943786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b261c6f-644d-4135-af58-2959a77ce6b6 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:07.979850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde1a16-ffaa-45d2-9da7-d06c67da7ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:07.980527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde1a16-ffaa-45d2-9da7-d06c67da7ccb None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:07.980818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde1a16-ffaa-45d2-9da7-d06c67da7ccb None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:07.981101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde1a16-ffaa-45d2-9da7-d06c67da7ccb None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:07.981818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde1a16-ffaa-45d2-9da7-d06c67da7ccb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:07.983265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde1a16-ffaa-45d2-9da7-d06c67da7ccb None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:08.053133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b261c6f-644d-4135-af58-2959a77ce6b6 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:08.054680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:08.063316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:08.069641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 45/90] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:32:07 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:32:08.076788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde1a16-ffaa-45d2-9da7-d06c67da7ccb None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:08.095916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f06bd7-870e-4d22-a8a2-eb3444558ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:08.096596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f06bd7-870e-4d22-a8a2-eb3444558ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:08.096884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f06bd7-870e-4d22-a8a2-eb3444558ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:08.097167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f06bd7-870e-4d22-a8a2-eb3444558ed5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:08.184941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f06bd7-870e-4d22-a8a2-eb3444558ed5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:08.186799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f06bd7-870e-4d22-a8a2-eb3444558ed5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:08.214191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde1a16-ffaa-45d2-9da7-d06c67da7ccb None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:08.254423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc94bd7-cb0f-4ebd-a96c-d023596e77bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:08.255097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94bd7-cb0f-4ebd-a96c-d023596e77bd None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:08.255407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94bd7-cb0f-4ebd-a96c-d023596e77bd None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:08.255694 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94bd7-cb0f-4ebd-a96c-d023596e77bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:08.315548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 46/91] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:08.320428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f06bd7-870e-4d22-a8a2-eb3444558ed5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:08.321744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:08.346327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:08.349763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc94bd7-cb0f-4ebd-a96c-d023596e77bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:08.351686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc94bd7-cb0f-4ebd-a96c-d023596e77bd None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:08.456861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f06bd7-870e-4d22-a8a2-eb3444558ed5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:08.497105 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 46/92] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:08.498353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc94bd7-cb0f-4ebd-a96c-d023596e77bd None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:08.510132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd053-d5a4-403b-a541-f776c2467fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:08.511186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd053-d5a4-403b-a541-f776c2467fe3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:08.511516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd053-d5a4-403b-a541-f776c2467fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:08.515378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd053-d5a4-403b-a541-f776c2467fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:08.515378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dd053-d5a4-403b-a541-f776c2467fe3 None admin] RBAC: Adding query filter params (role.id=0b03acccb970430e8e3b5a7921cb70d0, scope.project.id=82e4708d10bd4a56b8c263303c8beb29, user.id=d9586b808f424d84881b2efb78ae761f) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:08.515378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dd053-d5a4-403b-a541-f776c2467fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:08.515623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dd053-d5a4-403b-a541-f776c2467fe3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:08.524129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 47/93] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:08 2022] GET /identity/v3/role_assignments?user.id=d9586b808f424d84881b2efb78ae761f&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:08.528383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd053-d5a4-403b-a541-f776c2467fe3 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:08.651427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:08.698872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd053-d5a4-403b-a541-f776c2467fe3 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:08.705146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:08.713825 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc94bd7-cb0f-4ebd-a96c-d023596e77bd None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:08.748703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878aa8d-b4ed-4df4-85f0-b57668573254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:08.750857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878aa8d-b4ed-4df4-85f0-b57668573254 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:08.751386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878aa8d-b4ed-4df4-85f0-b57668573254 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:08.751872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878aa8d-b4ed-4df4-85f0-b57668573254 None admin] PATH_INFO: `/v3/projects/20842153d694444a83d8a97124b7842f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:08.753402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878aa8d-b4ed-4df4-85f0-b57668573254 None admin] RBAC: Authorizing `identity:get_project(project_id=20842153d694444a83d8a97124b7842f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:08.755161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878aa8d-b4ed-4df4-85f0-b57668573254 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:08.757140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 48/94] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:08 2022] GET /identity/v3/projects/20842153d694444a83d8a97124b7842f => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:08.763116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878aa8d-b4ed-4df4-85f0-b57668573254 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:08.780623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38028ba2-b2aa-4180-a861-5b7a8b606e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:08.782129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38028ba2-b2aa-4180-a861-5b7a8b606e9e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:08.782464 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38028ba2-b2aa-4180-a861-5b7a8b606e9e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:08.782916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38028ba2-b2aa-4180-a861-5b7a8b606e9e None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:08.784229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38028ba2-b2aa-4180-a861-5b7a8b606e9e None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:08.785737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38028ba2-b2aa-4180-a861-5b7a8b606e9e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:08.792739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 47/95] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:08 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:08.799536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38028ba2-b2aa-4180-a861-5b7a8b606e9e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:08.973733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878aa8d-b4ed-4df4-85f0-b57668573254 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:09.048757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae518087-c932-4ecd-a81b-810cfa644fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:09.049426 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae518087-c932-4ecd-a81b-810cfa644fb4 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:09.049708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae518087-c932-4ecd-a81b-810cfa644fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:09.049982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae518087-c932-4ecd-a81b-810cfa644fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:09.050819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae518087-c932-4ecd-a81b-810cfa644fb4 None admin] RBAC: Adding query filter params (role.id=0b03acccb970430e8e3b5a7921cb70d0, scope.project.id=20842153d694444a83d8a97124b7842f, user.id=d9586b808f424d84881b2efb78ae761f) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:09.051133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae518087-c932-4ecd-a81b-810cfa644fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:09.053012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae518087-c932-4ecd-a81b-810cfa644fb4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:09.054973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:09.058297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38028ba2-b2aa-4180-a861-5b7a8b606e9e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:09.059772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 49/96] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:08 2022] GET /identity/v3/role_assignments?user.id=d9586b808f424d84881b2efb78ae761f&scope.project.id=20842153d694444a83d8a97124b7842f&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:09.123159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15972d11-a46e-4d83-a5ac-c6bda8a0955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:09.123904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15972d11-a46e-4d83-a5ac-c6bda8a0955a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:09.124186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15972d11-a46e-4d83-a5ac-c6bda8a0955a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:09.124467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15972d11-a46e-4d83-a5ac-c6bda8a0955a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:09.125991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15972d11-a46e-4d83-a5ac-c6bda8a0955a None admin] RBAC: Adding query filter params (role.id=3ef6518e7cfb491dab86c245c0aeac21, scope.project.id=82e4708d10bd4a56b8c263303c8beb29, user.id=d9586b808f424d84881b2efb78ae761f) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:09.126450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15972d11-a46e-4d83-a5ac-c6bda8a0955a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:09.128101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15972d11-a46e-4d83-a5ac-c6bda8a0955a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:09.137498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 48/97] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:08 2022] GET /identity/v3/role_assignments?user.id=d9586b808f424d84881b2efb78ae761f&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=3ef6518e7cfb491dab86c245c0aeac21 => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:10.082753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05835f6e-880c-444a-8e94-5326b8437842 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:10.083771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05835f6e-880c-444a-8e94-5326b8437842 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:10.084260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05835f6e-880c-444a-8e94-5326b8437842 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:10.085884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 50/98] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:10.091277 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335b97a-c6a9-4211-84ee-9e3f0e7915b8 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:10.092105 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335b97a-c6a9-4211-84ee-9e3f0e7915b8 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:10.092581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335b97a-c6a9-4211-84ee-9e3f0e7915b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:10.113230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-0335b97a-c6a9-4211-84ee-9e3f0e7915b8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:10.114732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0335b97a-c6a9-4211-84ee-9e3f0e7915b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:10.153230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:10.198690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 49/99] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:10.232752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05835f6e-880c-444a-8e94-5326b8437842 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:10.358195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05835f6e-880c-444a-8e94-5326b8437842 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:10.404085 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b764c69-4287-4148-a66f-26e33fd53c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:10.405312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b764c69-4287-4148-a66f-26e33fd53c2b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:10.405859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b764c69-4287-4148-a66f-26e33fd53c2b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:10.406359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b764c69-4287-4148-a66f-26e33fd53c2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:10.422854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b764c69-4287-4148-a66f-26e33fd53c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-7b764c69-4287-4148-a66f-26e33fd53c2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:10.430886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:10.431784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:10.432530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:10.434495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 51/100] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:32:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:10.441558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335b97a-c6a9-4211-84ee-9e3f0e7915b8 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:10.580063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335b97a-c6a9-4211-84ee-9e3f0e7915b8 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:10.626108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983f3a-5d17-445b-a669-8d52b1efe173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:10.627158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983f3a-5d17-445b-a669-8d52b1efe173 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:10.627635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983f3a-5d17-445b-a669-8d52b1efe173 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:10.628096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983f3a-5d17-445b-a669-8d52b1efe173 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:10.629009 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d983f3a-5d17-445b-a669-8d52b1efe173 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:10.629501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d983f3a-5d17-445b-a669-8d52b1efe173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:10.631044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d983f3a-5d17-445b-a669-8d52b1efe173 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:10.644750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 50/101] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:10.650343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b764c69-4287-4148-a66f-26e33fd53c2b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:10.727014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:10.784411 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b764c69-4287-4148-a66f-26e33fd53c2b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:10.841709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b72c6-3591-40c0-8997-34eb9409da6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:10.842906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b72c6-3591-40c0-8997-34eb9409da6a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:10.843381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b72c6-3591-40c0-8997-34eb9409da6a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:10.843869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b72c6-3591-40c0-8997-34eb9409da6a None admin] PATH_INFO: `/v3/users/1449ff4f407540dd843ab2db406229f6` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:10.846103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b72c6-3591-40c0-8997-34eb9409da6a None admin] RBAC: Authorizing `identity:get_user(user_id=1449ff4f407540dd843ab2db406229f6)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:10.847926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b72c6-3591-40c0-8997-34eb9409da6a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:10.849813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 52/102] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:10 2022] GET /identity/v3/users/1449ff4f407540dd843ab2db406229f6 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:10.855693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983f3a-5d17-445b-a669-8d52b1efe173 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:10.892021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:11.057308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d983f3a-5d17-445b-a669-8d52b1efe173 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:11.136492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695d56c-2497-4d64-bdf4-ddbea0815c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:11.139078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695d56c-2497-4d64-bdf4-ddbea0815c10 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:11.139840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695d56c-2497-4d64-bdf4-ddbea0815c10 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:11.140570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695d56c-2497-4d64-bdf4-ddbea0815c10 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:11.148639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695d56c-2497-4d64-bdf4-ddbea0815c10 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:11.151691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695d56c-2497-4d64-bdf4-ddbea0815c10 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:11.155121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 51/103] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:10 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:11.162352 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b72c6-3591-40c0-8997-34eb9409da6a None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:11.417552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b72c6-3591-40c0-8997-34eb9409da6a None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:11.524420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:11.568555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583d6d3-b7e5-4044-bb4b-7a7acc82bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:11.569695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d6d3-b7e5-4044-bb4b-7a7acc82bab1 None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:11.570076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d6d3-b7e5-4044-bb4b-7a7acc82bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:11.570470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d6d3-b7e5-4044-bb4b-7a7acc82bab1 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29/users/1449ff4f407540dd843ab2db406229f6/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:11.582127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583d6d3-b7e5-4044-bb4b-7a7acc82bab1 None admin] RBAC: Authorizing `identity:create_grant(project_id=82e4708d10bd4a56b8c263303c8beb29, user_id=1449ff4f407540dd843ab2db406229f6, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:11.583039 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583d6d3-b7e5-4044-bb4b-7a7acc82bab1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:11.692997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 53/104] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:32:11 2022] PUT /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29/users/1449ff4f407540dd843ab2db406229f6/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:11.812226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429490-b989-49a2-8a67-654c1df62da7 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:11.812540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429490-b989-49a2-8a67-654c1df62da7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:11.813685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429490-b989-49a2-8a67-654c1df62da7 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:11.814966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 52/105] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:11.820537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2b796-af33-488a-9f10-2796b306b6de None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:11.820872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2b796-af33-488a-9f10-2796b306b6de None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:11.821107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2b796-af33-488a-9f10-2796b306b6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:11.851424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f9d2b796-af33-488a-9f10-2796b306b6de None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:11.853073 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f9d2b796-af33-488a-9f10-2796b306b6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:11.963824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 54/106] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:11.991994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429490-b989-49a2-8a67-654c1df62da7 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:12.183314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:12.209210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429490-b989-49a2-8a67-654c1df62da7 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:12.290216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32389858-fdc5-4821-8722-e1016c8580c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:12.291038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32389858-fdc5-4821-8722-e1016c8580c6 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:12.291324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32389858-fdc5-4821-8722-e1016c8580c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:12.291623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32389858-fdc5-4821-8722-e1016c8580c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:12.296071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32389858-fdc5-4821-8722-e1016c8580c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:12.298315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32389858-fdc5-4821-8722-e1016c8580c6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:12.300043 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 53/107] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:32:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:12.307414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2b796-af33-488a-9f10-2796b306b6de None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:12.332447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621efbc-1e6f-4f4c-8137-fac62061db89 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:12.332888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621efbc-1e6f-4f4c-8137-fac62061db89 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:12.333010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621efbc-1e6f-4f4c-8137-fac62061db89 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:12.338737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 54/108] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:12.340125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a98a3-9739-4311-8c18-1a4b769a334b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:12.340414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a98a3-9739-4311-8c18-1a4b769a334b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:12.340803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a98a3-9739-4311-8c18-1a4b769a334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:12.383395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-432a98a3-9739-4311-8c18-1a4b769a334b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:12.384711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-432a98a3-9739-4311-8c18-1a4b769a334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:12.460354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2b796-af33-488a-9f10-2796b306b6de None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:12.489218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:12.511381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59135a5-4dc6-4d64-adc8-f207ad73eeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:12.512562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59135a5-4dc6-4d64-adc8-f207ad73eeea None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:12.513168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59135a5-4dc6-4d64-adc8-f207ad73eeea None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:12.513664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59135a5-4dc6-4d64-adc8-f207ad73eeea None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:12.514602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59135a5-4dc6-4d64-adc8-f207ad73eeea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:12.517769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59135a5-4dc6-4d64-adc8-f207ad73eeea None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:12.572991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 55/109] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:12.574725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7abf30-de2f-4078-8e4a-783932f7ac18 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:12.575291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7abf30-de2f-4078-8e4a-783932f7ac18 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:12.575866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7abf30-de2f-4078-8e4a-783932f7ac18 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:12.577793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 56/110] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:12.585252 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2c15-05c9-42d3-bd2e-9cdfa66475e3 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:12.585883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2c15-05c9-42d3-bd2e-9cdfa66475e3 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:12.586364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2c15-05c9-42d3-bd2e-9cdfa66475e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:12.632955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 55/111] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:32:12 2022] POST /identity/v3/projects => generated 302 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:32:12.634320 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59135a5-4dc6-4d64-adc8-f207ad73eeea None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:12.659392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-440c2c15-05c9-42d3-bd2e-9cdfa66475e3 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:12.661460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-440c2c15-05c9-42d3-bd2e-9cdfa66475e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:12.879741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 57/112] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:12.885170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999ab6e-fc33-42ce-8ef2-aef5998df2ab None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:12.885613 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999ab6e-fc33-42ce-8ef2-aef5998df2ab None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:12.886039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999ab6e-fc33-42ce-8ef2-aef5998df2ab None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:12.888375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 58/113] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:12.896201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c68992-4feb-4a93-8d73-18e4c007d0e6 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:12.896816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c68992-4feb-4a93-8d73-18e4c007d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:12.897249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c68992-4feb-4a93-8d73-18e4c007d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:12.950558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-e4c68992-4feb-4a93-8d73-18e4c007d0e6 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:12.950558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e4c68992-4feb-4a93-8d73-18e4c007d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:12.996651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59135a5-4dc6-4d64-adc8-f207ad73eeea None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:13.004855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:13.083875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f4eb5-f4ed-4577-a613-050b60620928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:13.085070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f4eb5-f4ed-4577-a613-050b60620928 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:13.085588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f4eb5-f4ed-4577-a613-050b60620928 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:13.086069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f4eb5-f4ed-4577-a613-050b60620928 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:13.100441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f4eb5-f4ed-4577-a613-050b60620928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-062f4eb5-f4ed-4577-a613-050b60620928 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:13.109345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:13.110580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:13.111437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:13.114535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 56/114] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 481 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:13.115625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f4eb5-f4ed-4577-a613-050b60620928 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:13.149190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 59/115] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:13.151154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c68992-4feb-4a93-8d73-18e4c007d0e6 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:13.160966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:13.253795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f4eb5-f4ed-4577-a613-050b60620928 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:13.339373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5422cb4-da8f-4334-9364-ac71dc588f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:13.343375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5422cb4-da8f-4334-9364-ac71dc588f7e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:13.343375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5422cb4-da8f-4334-9364-ac71dc588f7e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:13.343375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5422cb4-da8f-4334-9364-ac71dc588f7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:13.385264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5422cb4-da8f-4334-9364-ac71dc588f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-f5422cb4-da8f-4334-9364-ac71dc588f7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:13.419484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:13.420392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:13.421162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 57/116] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:13.427422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5422cb4-da8f-4334-9364-ac71dc588f7e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:13.470059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c68992-4feb-4a93-8d73-18e4c007d0e6 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:13.539381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4830ec-d9d1-49ac-9af2-70f8a5775091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:13.539381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4830ec-d9d1-49ac-9af2-70f8a5775091 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:13.539381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4830ec-d9d1-49ac-9af2-70f8a5775091 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:13.539381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4830ec-d9d1-49ac-9af2-70f8a5775091 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:13.539910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4830ec-d9d1-49ac-9af2-70f8a5775091 None admin] RBAC: Adding query filter params (name=member) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:13.540223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4830ec-d9d1-49ac-9af2-70f8a5775091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:13.543380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4830ec-d9d1-49ac-9af2-70f8a5775091 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:13.559129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 60/117] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:13.563125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4830ec-d9d1-49ac-9af2-70f8a5775091 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:13.597049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:13.620177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:13.649270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5422cb4-da8f-4334-9364-ac71dc588f7e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:13.722765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec954c-c170-407f-b3f4-3c2eff0c06a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:13.725269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec954c-c170-407f-b3f4-3c2eff0c06a2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:13.725566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec954c-c170-407f-b3f4-3c2eff0c06a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:13.725854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec954c-c170-407f-b3f4-3c2eff0c06a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:13.750680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec954c-c170-407f-b3f4-3c2eff0c06a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-e2ec954c-c170-407f-b3f4-3c2eff0c06a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:13.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:13.763889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:13.764675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 58/118] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:13.771575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667998af-f42d-4c03-aa56-05366e0eb48d None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:13.771575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667998af-f42d-4c03-aa56-05366e0eb48d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:13.771575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667998af-f42d-4c03-aa56-05366e0eb48d None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:13.771575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 59/119] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:13.771575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667998af-f42d-4c03-aa56-05366e0eb48d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:13.784394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4830ec-d9d1-49ac-9af2-70f8a5775091 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:13.856871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5bf1f-1d03-4cf4-9bf2-336f7f57aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:13.857569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5bf1f-1d03-4cf4-9bf2-336f7f57aa09 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:13.857851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5bf1f-1d03-4cf4-9bf2-336f7f57aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:13.858137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5bf1f-1d03-4cf4-9bf2-336f7f57aa09 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:13.859071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5bf1f-1d03-4cf4-9bf2-336f7f57aa09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:13.859254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5bf1f-1d03-4cf4-9bf2-336f7f57aa09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:13.861689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5bf1f-1d03-4cf4-9bf2-336f7f57aa09 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:13.881512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 61/120] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:13.883157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5bf1f-1d03-4cf4-9bf2-336f7f57aa09 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:13.924749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667998af-f42d-4c03-aa56-05366e0eb48d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:13.970616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd1be0-f95f-426f-b653-62cfbdd8b0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:13.972389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd1be0-f95f-426f-b653-62cfbdd8b0f9 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:13.972943 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd1be0-f95f-426f-b653-62cfbdd8b0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:13.973808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd1be0-f95f-426f-b653-62cfbdd8b0f9 None admin] PATH_INFO: `/v3/users/d9586b808f424d84881b2efb78ae761f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:13.975443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd1be0-f95f-426f-b653-62cfbdd8b0f9 None admin] RBAC: Authorizing `identity:get_user(user_id=d9586b808f424d84881b2efb78ae761f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:13.977681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd1be0-f95f-426f-b653-62cfbdd8b0f9 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:13.979709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 60/121] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:13 2022] GET /identity/v3/users/d9586b808f424d84881b2efb78ae761f => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:13.982462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb09c9-a777-44d1-a0aa-9a3cc0b5e999 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:13.982951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb09c9-a777-44d1-a0aa-9a3cc0b5e999 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:13.983431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb09c9-a777-44d1-a0aa-9a3cc0b5e999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:14.004705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:14.013979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-2fcb09c9-a777-44d1-a0aa-9a3cc0b5e999 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:14.020242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2fcb09c9-a777-44d1-a0aa-9a3cc0b5e999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:14.036071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:14.045443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5bf1f-1d03-4cf4-9bf2-336f7f57aa09 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:14.093169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26f2c5-9f1f-4186-a740-39302d52c4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:14.094262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26f2c5-9f1f-4186-a740-39302d52c4d8 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:14.094748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26f2c5-9f1f-4186-a740-39302d52c4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:14.095236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26f2c5-9f1f-4186-a740-39302d52c4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:14.096317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26f2c5-9f1f-4186-a740-39302d52c4d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:14.096839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26f2c5-9f1f-4186-a740-39302d52c4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:14.099111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26f2c5-9f1f-4186-a740-39302d52c4d8 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:14.112683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 62/122] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:14.113626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26f2c5-9f1f-4186-a740-39302d52c4d8 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:14.119494 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 61/123] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:14.120705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb09c9-a777-44d1-a0aa-9a3cc0b5e999 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:14.252965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb09c9-a777-44d1-a0aa-9a3cc0b5e999 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:14.300630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aacf58-a944-4e9a-84fd-ebc8f1195c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:14.301846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aacf58-a944-4e9a-84fd-ebc8f1195c22 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:14.302328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aacf58-a944-4e9a-84fd-ebc8f1195c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:14.302776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aacf58-a944-4e9a-84fd-ebc8f1195c22 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:14.307158 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aacf58-a944-4e9a-84fd-ebc8f1195c22 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:14.309459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aacf58-a944-4e9a-84fd-ebc8f1195c22 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:14.313264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 62/124] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:14 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:14.315520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aacf58-a944-4e9a-84fd-ebc8f1195c22 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:14.334748 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:14.342268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26f2c5-9f1f-4186-a740-39302d52c4d8 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:14.429868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72176b1b-8fab-4caa-b0ad-2ceeb55752ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:14.431526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176b1b-8fab-4caa-b0ad-2ceeb55752ea None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:14.432068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176b1b-8fab-4caa-b0ad-2ceeb55752ea None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:14.432614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176b1b-8fab-4caa-b0ad-2ceeb55752ea None admin] PATH_INFO: `/v3/users/3053220009774402bf42e0fd6204d7fa` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:14.437688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:14.449365 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aacf58-a944-4e9a-84fd-ebc8f1195c22 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:14.479603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72176b1b-8fab-4caa-b0ad-2ceeb55752ea None admin] RBAC: Authorizing `identity:get_user(user_id=3053220009774402bf42e0fd6204d7fa)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:14.479603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72176b1b-8fab-4caa-b0ad-2ceeb55752ea None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:14.480462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 63/125] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:14 2022] GET /identity/v3/users/3053220009774402bf42e0fd6204d7fa => generated 289 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:14.481013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72176b1b-8fab-4caa-b0ad-2ceeb55752ea None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:14.564427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b8143-32e9-4973-ac86-9828b03151c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:14.565246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8143-32e9-4973-ac86-9828b03151c8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:14.566399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8143-32e9-4973-ac86-9828b03151c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:14.566399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b8143-32e9-4973-ac86-9828b03151c8 None admin] PATH_INFO: `/v3/users/d9586b808f424d84881b2efb78ae761f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:14.567256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b8143-32e9-4973-ac86-9828b03151c8 None admin] RBAC: Authorizing `identity:get_user(user_id=d9586b808f424d84881b2efb78ae761f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:14.568749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b8143-32e9-4973-ac86-9828b03151c8 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:14.570407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 63/126] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:14 2022] GET /identity/v3/users/d9586b808f424d84881b2efb78ae761f => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:14.571150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b8143-32e9-4973-ac86-9828b03151c8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:14.638662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72176b1b-8fab-4caa-b0ad-2ceeb55752ea None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:14.699246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014df75-d583-4eaf-aa05-7a5ebb6fdc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:14.700361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014df75-d583-4eaf-aa05-7a5ebb6fdc07 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:14.700705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014df75-d583-4eaf-aa05-7a5ebb6fdc07 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:14.701166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014df75-d583-4eaf-aa05-7a5ebb6fdc07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:14.727558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014df75-d583-4eaf-aa05-7a5ebb6fdc07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-4014df75-d583-4eaf-aa05-7a5ebb6fdc07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:14.742790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:14.743751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:14.744526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:14.745893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 64/127] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:14.746162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:14.753042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014df75-d583-4eaf-aa05-7a5ebb6fdc07 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:14.790256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b8143-32e9-4973-ac86-9828b03151c8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:14.847866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:14.865755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba62f2-fd24-4688-a92f-0025386fb05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:14.871377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba62f2-fd24-4688-a92f-0025386fb05d None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:14.871377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba62f2-fd24-4688-a92f-0025386fb05d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:14.871377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba62f2-fd24-4688-a92f-0025386fb05d None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29/users/d9586b808f424d84881b2efb78ae761f/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:14.871377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba62f2-fd24-4688-a92f-0025386fb05d None admin] RBAC: Authorizing `identity:create_grant(project_id=82e4708d10bd4a56b8c263303c8beb29, user_id=d9586b808f424d84881b2efb78ae761f, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:14.875517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba62f2-fd24-4688-a92f-0025386fb05d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:14.895377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014df75-d583-4eaf-aa05-7a5ebb6fdc07 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a7815-32ad-4af6-8e9e-1e9672341519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:14.943173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7815-32ad-4af6-8e9e-1e9672341519 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:14.943173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7815-32ad-4af6-8e9e-1e9672341519 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:14.943173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7815-32ad-4af6-8e9e-1e9672341519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:14.986560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 64/128] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:32:14 2022] PUT /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29/users/d9586b808f424d84881b2efb78ae761f/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:14.987554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba62f2-fd24-4688-a92f-0025386fb05d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:15.082426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a7815-32ad-4af6-8e9e-1e9672341519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:15.085088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a7815-32ad-4af6-8e9e-1e9672341519 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:15.225913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:15.236933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba62f2-fd24-4688-a92f-0025386fb05d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:15.280739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f37beb-90e5-4c83-83cb-39eba237e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:15.281775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f37beb-90e5-4c83-83cb-39eba237e943 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:15.282061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f37beb-90e5-4c83-83cb-39eba237e943 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:15.282389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f37beb-90e5-4c83-83cb-39eba237e943 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:15.283996 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f37beb-90e5-4c83-83cb-39eba237e943 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:15.285514 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f37beb-90e5-4c83-83cb-39eba237e943 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:15.288438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 65/129] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:14 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:15.289318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f37beb-90e5-4c83-83cb-39eba237e943 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:15.300081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 65/130] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:15.300975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a7815-32ad-4af6-8e9e-1e9672341519 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:15.310737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:15.418854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f37beb-90e5-4c83-83cb-39eba237e943 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:15.429394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a7815-32ad-4af6-8e9e-1e9672341519 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:15.473258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc6ec4-5bbc-4eb1-a21d-f38b30b9d895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:15.474055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc6ec4-5bbc-4eb1-a21d-f38b30b9d895 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:15.474293 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc6ec4-5bbc-4eb1-a21d-f38b30b9d895 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:15.474575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc6ec4-5bbc-4eb1-a21d-f38b30b9d895 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:15.475327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc6ec4-5bbc-4eb1-a21d-f38b30b9d895 None admin] RBAC: Adding query filter params (name=member) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:15.477366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc6ec4-5bbc-4eb1-a21d-f38b30b9d895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:15.478783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc6ec4-5bbc-4eb1-a21d-f38b30b9d895 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:15.493751 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 66/131] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:15.494125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc6ec4-5bbc-4eb1-a21d-f38b30b9d895 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:15.524670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc487536-742e-431c-92cd-d733e5064852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:15.525674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc487536-742e-431c-92cd-d733e5064852 None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:15.526006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc487536-742e-431c-92cd-d733e5064852 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:15.526301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc487536-742e-431c-92cd-d733e5064852 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29/users/d9586b808f424d84881b2efb78ae761f/roles/3ef6518e7cfb491dab86c245c0aeac21` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:15.540440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc487536-742e-431c-92cd-d733e5064852 None admin] RBAC: Authorizing `identity:create_grant(project_id=82e4708d10bd4a56b8c263303c8beb29, user_id=d9586b808f424d84881b2efb78ae761f, role_id=3ef6518e7cfb491dab86c245c0aeac21)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:15.541964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc487536-742e-431c-92cd-d733e5064852 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:15.600881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:15.621473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 66/132] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:32:15 2022] PUT /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29/users/d9586b808f424d84881b2efb78ae761f/roles/3ef6518e7cfb491dab86c245c0aeac21 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:15.626674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649ca6-8709-46ff-97b6-6fbf729305a4 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:15.627134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649ca6-8709-46ff-97b6-6fbf729305a4 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:15.627777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65649ca6-8709-46ff-97b6-6fbf729305a4 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:15.634583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 67/133] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:15.634583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65649ca6-8709-46ff-97b6-6fbf729305a4 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:15.684304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc6ec4-5bbc-4eb1-a21d-f38b30b9d895 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:15.700542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:15.798078 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33effc62-aded-4144-af24-2978e9892302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:15.800187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33effc62-aded-4144-af24-2978e9892302 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:15.801023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33effc62-aded-4144-af24-2978e9892302 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:15.801753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33effc62-aded-4144-af24-2978e9892302 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:15.808376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33effc62-aded-4144-af24-2978e9892302 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:15.811833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33effc62-aded-4144-af24-2978e9892302 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:15.817017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 67/134] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:15 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:15.820141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a55268-a982-423f-b6ac-df59a56e9166 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:15.820899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a55268-a982-423f-b6ac-df59a56e9166 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:15.821628 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a55268-a982-423f-b6ac-df59a56e9166 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:15.824808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 68/135] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:15.826253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61584a9-3270-496a-b642-f90e519f42b0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:15.826546 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61584a9-3270-496a-b642-f90e519f42b0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:15.827028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61584a9-3270-496a-b642-f90e519f42b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:15.867017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f61584a9-3270-496a-b642-f90e519f42b0 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:15.869220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f61584a9-3270-496a-b642-f90e519f42b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:15.908708 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65649ca6-8709-46ff-97b6-6fbf729305a4 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:15.964928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058f32a-2c8e-4656-8eda-7aa6811b2f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:15.965848 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058f32a-2c8e-4656-8eda-7aa6811b2f20 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:15.966133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058f32a-2c8e-4656-8eda-7aa6811b2f20 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:15.966711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058f32a-2c8e-4656-8eda-7aa6811b2f20 None admin] PATH_INFO: `/v3/users/d9586b808f424d84881b2efb78ae761f` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:15.967698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058f32a-2c8e-4656-8eda-7aa6811b2f20 None admin] RBAC: Authorizing `identity:get_user(user_id=d9586b808f424d84881b2efb78ae761f)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:15.969912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058f32a-2c8e-4656-8eda-7aa6811b2f20 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:15.977677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 68/136] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:15 2022] GET /identity/v3/users/d9586b808f424d84881b2efb78ae761f => generated 275 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:15.978354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058f32a-2c8e-4656-8eda-7aa6811b2f20 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:16.020483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 69/137] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:16.023376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2e305-14a7-4a62-94d6-8b4b535cdc6b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:16.023376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2e305-14a7-4a62-94d6-8b4b535cdc6b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:16.023376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2e305-14a7-4a62-94d6-8b4b535cdc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:16.076477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3eb2e305-14a7-4a62-94d6-8b4b535cdc6b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:16.077581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3eb2e305-14a7-4a62-94d6-8b4b535cdc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:16.164874 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:16.192392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058f32a-2c8e-4656-8eda-7aa6811b2f20 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:16.210161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:16.222313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 70/138] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:16.224167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2e305-14a7-4a62-94d6-8b4b535cdc6b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:16.257887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45423815-e942-4b23-8731-03c67af2a9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:16.258570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45423815-e942-4b23-8731-03c67af2a9a0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:16.258851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45423815-e942-4b23-8731-03c67af2a9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:16.259130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45423815-e942-4b23-8731-03c67af2a9a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:16.260014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45423815-e942-4b23-8731-03c67af2a9a0 None admin] RBAC: Adding query filter params (role.id=9ee3b802458741a6be937b8b8dcdc3f6, scope.project.id=82e4708d10bd4a56b8c263303c8beb29, user.id=3053220009774402bf42e0fd6204d7fa) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:16.260328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45423815-e942-4b23-8731-03c67af2a9a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:16.261879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45423815-e942-4b23-8731-03c67af2a9a0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:16.289686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 69/139] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:15 2022] GET /identity/v3/role_assignments?user.id=3053220009774402bf42e0fd6204d7fa&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=9ee3b802458741a6be937b8b8dcdc3f6 => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:16.289686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45423815-e942-4b23-8731-03c67af2a9a0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:16.440795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2e305-14a7-4a62-94d6-8b4b535cdc6b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:16.525955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1bf14-881f-486b-9dc4-9556e55178fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:16.528885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45423815-e942-4b23-8731-03c67af2a9a0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:16.530373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1bf14-881f-486b-9dc4-9556e55178fd None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:16.530862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1bf14-881f-486b-9dc4-9556e55178fd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:16.531379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1bf14-881f-486b-9dc4-9556e55178fd None admin] PATH_INFO: `/v3/projects/20842153d694444a83d8a97124b7842f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:16.534821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1bf14-881f-486b-9dc4-9556e55178fd None admin] RBAC: Authorizing `identity:get_project(project_id=20842153d694444a83d8a97124b7842f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:16.536701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1bf14-881f-486b-9dc4-9556e55178fd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:16.546886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 71/140] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:16 2022] GET /identity/v3/projects/20842153d694444a83d8a97124b7842f => generated 312 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:16.548350 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1bf14-881f-486b-9dc4-9556e55178fd None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:16.624983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36fca5-9d45-4550-b0d4-90cb008d3a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:16.626228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36fca5-9d45-4550-b0d4-90cb008d3a8a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:16.628296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36fca5-9d45-4550-b0d4-90cb008d3a8a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:16.629042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36fca5-9d45-4550-b0d4-90cb008d3a8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:16.657610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36fca5-9d45-4550-b0d4-90cb008d3a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-8d36fca5-9d45-4550-b0d4-90cb008d3a8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:16.672585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:16.673543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:16.674307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:16.682043 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 70/141] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:32:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:16.685817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36fca5-9d45-4550-b0d4-90cb008d3a8a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:16.699066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:16.710972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:16.805370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1bf14-881f-486b-9dc4-9556e55178fd None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:16.839970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36fca5-9d45-4550-b0d4-90cb008d3a8a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:16.885486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a752929-56fe-46fe-8d0d-ed12fdb2178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:16.889126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a752929-56fe-46fe-8d0d-ed12fdb2178f None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:16.889662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a752929-56fe-46fe-8d0d-ed12fdb2178f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:16.890150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a752929-56fe-46fe-8d0d-ed12fdb2178f None admin] PATH_INFO: `/v3/projects/20842153d694444a83d8a97124b7842f/users/d9586b808f424d84881b2efb78ae761f/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:16.894658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a752929-56fe-46fe-8d0d-ed12fdb2178f None admin] RBAC: Authorizing `identity:create_grant(project_id=20842153d694444a83d8a97124b7842f, user_id=d9586b808f424d84881b2efb78ae761f, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:16.897958 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a752929-56fe-46fe-8d0d-ed12fdb2178f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:16.908575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e46587-3f01-414a-84a1-4096bc24032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:16.909959 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e46587-3f01-414a-84a1-4096bc24032d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:16.910531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e46587-3f01-414a-84a1-4096bc24032d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:16.911005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e46587-3f01-414a-84a1-4096bc24032d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:16.912675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e46587-3f01-414a-84a1-4096bc24032d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:16.914409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e46587-3f01-414a-84a1-4096bc24032d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:16.916403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 72/142] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:32:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:16.923802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e46587-3f01-414a-84a1-4096bc24032d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:16.990791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 71/143] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:32:16 2022] PUT /identity/v3/projects/20842153d694444a83d8a97124b7842f/users/d9586b808f424d84881b2efb78ae761f/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:16.991873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a752929-56fe-46fe-8d0d-ed12fdb2178f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:17.095063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e46587-3f01-414a-84a1-4096bc24032d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:17.178285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:17.196247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0fde4-d335-479e-9324-391c2bbc9be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:17.197118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0fde4-d335-479e-9324-391c2bbc9be5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:17.197222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0fde4-d335-479e-9324-391c2bbc9be5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:17.197548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0fde4-d335-479e-9324-391c2bbc9be5 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:17.198734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0fde4-d335-479e-9324-391c2bbc9be5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:17.198734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0fde4-d335-479e-9324-391c2bbc9be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:17.200062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0fde4-d335-479e-9324-391c2bbc9be5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:17.203139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:17.221386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 73/144] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:17.227975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0fde4-d335-479e-9324-391c2bbc9be5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:17.288480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a752929-56fe-46fe-8d0d-ed12fdb2178f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:17.356343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e810878-9708-458f-8b02-7ff30be02d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:17.357038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e810878-9708-458f-8b02-7ff30be02d09 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:17.357318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e810878-9708-458f-8b02-7ff30be02d09 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:17.357590 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e810878-9708-458f-8b02-7ff30be02d09 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:17.358315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e810878-9708-458f-8b02-7ff30be02d09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:17.362235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e810878-9708-458f-8b02-7ff30be02d09 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:17.421796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0fde4-d335-479e-9324-391c2bbc9be5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:17.474065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57a460-83d8-40fe-9d25-8061f6104391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:17.480195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57a460-83d8-40fe-9d25-8061f6104391 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:17.481539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57a460-83d8-40fe-9d25-8061f6104391 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:17.481539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57a460-83d8-40fe-9d25-8061f6104391 None admin] PATH_INFO: `/v3/users/1449ff4f407540dd843ab2db406229f6` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:17.482051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57a460-83d8-40fe-9d25-8061f6104391 None admin] RBAC: Authorizing `identity:get_user(user_id=1449ff4f407540dd843ab2db406229f6)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:17.491780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57a460-83d8-40fe-9d25-8061f6104391 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:17.493923 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 74/145] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:17 2022] GET /identity/v3/users/1449ff4f407540dd843ab2db406229f6 => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:17.499203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57a460-83d8-40fe-9d25-8061f6104391 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:17.512844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 72/146] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:32:16 2022] POST /identity/v3/users => generated 283 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:32:17.627541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:17.711718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57a460-83d8-40fe-9d25-8061f6104391 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:17.784263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854769c8-4b83-4aca-a988-de52929035ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:17.784954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854769c8-4b83-4aca-a988-de52929035ad None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:17.785300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854769c8-4b83-4aca-a988-de52929035ad None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:17.785581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854769c8-4b83-4aca-a988-de52929035ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:17.915978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854769c8-4b83-4aca-a988-de52929035ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:17.917492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854769c8-4b83-4aca-a988-de52929035ad None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:18.015111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:18.054948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 75/147] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:32:18.064498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e810878-9708-458f-8b02-7ff30be02d09 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:18.079569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a215b1e-d2b5-4b9b-8865-5bcd3d891243 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:18.082730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a215b1e-d2b5-4b9b-8865-5bcd3d891243 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:18.083197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a215b1e-d2b5-4b9b-8865-5bcd3d891243 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:18.086699 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 76/148] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:18.092575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ccc50-a080-4375-bfcc-3d7a9a0873a0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:18.093022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ccc50-a080-4375-bfcc-3d7a9a0873a0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:18.093447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ccc50-a080-4375-bfcc-3d7a9a0873a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:18.129850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a28ccc50-a080-4375-bfcc-3d7a9a0873a0 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:18.134639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a28ccc50-a080-4375-bfcc-3d7a9a0873a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:18.278719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e810878-9708-458f-8b02-7ff30be02d09 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:18.304937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:18.309323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 77/149] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:18.325247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c363-584f-42cd-a19c-2d47fd790261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:18.326765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c363-584f-42cd-a19c-2d47fd790261 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:18.327248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c363-584f-42cd-a19c-2d47fd790261 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:18.327718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c363-584f-42cd-a19c-2d47fd790261 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:18.329195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660c363-584f-42cd-a19c-2d47fd790261 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:18.335916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660c363-584f-42cd-a19c-2d47fd790261 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:18.338884 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 73/150] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:18 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:18.348609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ccc50-a080-4375-bfcc-3d7a9a0873a0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:18.352229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c363-584f-42cd-a19c-2d47fd790261 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:18.529342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:18.537503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ccc50-a080-4375-bfcc-3d7a9a0873a0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:18.541048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c363-584f-42cd-a19c-2d47fd790261 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:18.584724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9963e-5fb0-4fcc-9039-9884ad6eea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:18.585897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9963e-5fb0-4fcc-9039-9884ad6eea14 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:18.588008 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8c1ed-3477-4e47-9794-1402fa11549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:18.588008 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8c1ed-3477-4e47-9794-1402fa11549f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:18.588222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8c1ed-3477-4e47-9794-1402fa11549f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:18.588404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8c1ed-3477-4e47-9794-1402fa11549f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:18.588654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9963e-5fb0-4fcc-9039-9884ad6eea14 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:18.589217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9963e-5fb0-4fcc-9039-9884ad6eea14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:18.590303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9963e-5fb0-4fcc-9039-9884ad6eea14 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=82e4708d10bd4a56b8c263303c8beb29, user.id=1449ff4f407540dd843ab2db406229f6) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:18.590815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9963e-5fb0-4fcc-9039-9884ad6eea14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:18.592560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9963e-5fb0-4fcc-9039-9884ad6eea14 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:18.600817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 78/151] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:18 2022] GET /identity/v3/role_assignments?user.id=1449ff4f407540dd843ab2db406229f6&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:18.611279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8c1ed-3477-4e47-9794-1402fa11549f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-62f8c1ed-3477-4e47-9794-1402fa11549f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:18.623628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:18.624545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:18.625784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 74/152] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:18.632986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9963e-5fb0-4fcc-9039-9884ad6eea14 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:18.803067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9963e-5fb0-4fcc-9039-9884ad6eea14 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:18.850898 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf6a24-6206-4f09-a5d5-4d4dbd2e800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:18.852068 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6a24-6206-4f09-a5d5-4d4dbd2e800a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:18.852572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6a24-6206-4f09-a5d5-4d4dbd2e800a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:18.853039 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6a24-6206-4f09-a5d5-4d4dbd2e800a None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:18.854063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf6a24-6206-4f09-a5d5-4d4dbd2e800a None admin] RBAC: Adding query filter params (name=member) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:18.854572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf6a24-6206-4f09-a5d5-4d4dbd2e800a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:18.858147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf6a24-6206-4f09-a5d5-4d4dbd2e800a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:18.868582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 79/153] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:18.878158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8c1ed-3477-4e47-9794-1402fa11549f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:19.014730 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:19.091725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3e62-663d-47c1-b3f4-2e67b809ec7e None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:19.092356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3e62-663d-47c1-b3f4-2e67b809ec7e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:19.092840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3e62-663d-47c1-b3f4-2e67b809ec7e None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:19.094991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 80/154] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:19.096773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8c1ed-3477-4e47-9794-1402fa11549f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:19.102054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec15f6-79ea-4525-9de6-0479cc1aa37a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:19.102617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec15f6-79ea-4525-9de6-0479cc1aa37a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:19.103104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec15f6-79ea-4525-9de6-0479cc1aa37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:19.147121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-c6ec15f6-79ea-4525-9de6-0479cc1aa37a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:19.148686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c6ec15f6-79ea-4525-9de6-0479cc1aa37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:19.171237 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:19.172742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a312ab4-49cf-47ee-8573-cf152fed6328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:19.173604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a312ab4-49cf-47ee-8573-cf152fed6328 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:19.173915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a312ab4-49cf-47ee-8573-cf152fed6328 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:19.174200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a312ab4-49cf-47ee-8573-cf152fed6328 None admin] PATH_INFO: `/v3/users/d9586b808f424d84881b2efb78ae761f` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:19.176117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a312ab4-49cf-47ee-8573-cf152fed6328 None admin] RBAC: Authorizing `identity:get_user(user_id=d9586b808f424d84881b2efb78ae761f)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:19.177394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a312ab4-49cf-47ee-8573-cf152fed6328 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:19.179114 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 75/155] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:18 2022] GET /identity/v3/users/d9586b808f424d84881b2efb78ae761f => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:19.186587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a312ab4-49cf-47ee-8573-cf152fed6328 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:19.253045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 81/156] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:19.301299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec15f6-79ea-4525-9de6-0479cc1aa37a None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:19.406708 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a312ab4-49cf-47ee-8573-cf152fed6328 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:19.455287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:19.492105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec15f6-79ea-4525-9de6-0479cc1aa37a None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:19.548032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7f834-b419-4235-8826-4cc37270847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:19.551577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c0040-874e-4345-8774-181328c06865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:19.551577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c0040-874e-4345-8774-181328c06865 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:19.551577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c0040-874e-4345-8774-181328c06865 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:19.551577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c0040-874e-4345-8774-181328c06865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:19.552911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7f834-b419-4235-8826-4cc37270847b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:19.553393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7f834-b419-4235-8826-4cc37270847b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:19.553861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7f834-b419-4235-8826-4cc37270847b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:19.574030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7f834-b419-4235-8826-4cc37270847b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-dcf7f834-b419-4235-8826-4cc37270847b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:19.589829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:19.590750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:19.591579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:19.594120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 82/157] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:19.599974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7f834-b419-4235-8826-4cc37270847b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:19.634480 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:19.807196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c0040-874e-4345-8774-181328c06865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:19.808872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c0040-874e-4345-8774-181328c06865 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:19.850067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7f834-b419-4235-8826-4cc37270847b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:19.943849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86e754-12e2-4472-b57f-ff08751fa5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:19.944535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86e754-12e2-4472-b57f-ff08751fa5ad None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:19.944818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86e754-12e2-4472-b57f-ff08751fa5ad None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:19.945091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86e754-12e2-4472-b57f-ff08751fa5ad None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:19.945924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86e754-12e2-4472-b57f-ff08751fa5ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:19.946156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86e754-12e2-4472-b57f-ff08751fa5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:19.947581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86e754-12e2-4472-b57f-ff08751fa5ad None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:19.965999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 83/158] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:19.967335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdcd92-963b-4e1b-87bd-32b3f220ed64 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:19.967648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdcd92-963b-4e1b-87bd-32b3f220ed64 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:19.967926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdcd92-963b-4e1b-87bd-32b3f220ed64 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:19.969879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 84/159] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:19.976094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdcd92-963b-4e1b-87bd-32b3f220ed64 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:20.059863 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 76/160] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 874 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:20.061106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be2182-6474-4027-bcee-61cf813b826c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:20.071930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be2182-6474-4027-bcee-61cf813b826c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:20.072239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be2182-6474-4027-bcee-61cf813b826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:20.116876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d2be2182-6474-4027-bcee-61cf813b826c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:20.119406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d2be2182-6474-4027-bcee-61cf813b826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:20.156695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:20.209935 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:20.265091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 77/161] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:20.267090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be2182-6474-4027-bcee-61cf813b826c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:20.298948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdcd92-963b-4e1b-87bd-32b3f220ed64 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:20.408436 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac047b-840f-4814-828c-67c129a995e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:20.409407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac047b-840f-4814-828c-67c129a995e8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:20.409690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac047b-840f-4814-828c-67c129a995e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:20.409964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac047b-840f-4814-828c-67c129a995e8 None admin] PATH_INFO: `/v3/users/d9586b808f424d84881b2efb78ae761f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:20.414074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac047b-840f-4814-828c-67c129a995e8 None admin] RBAC: Authorizing `identity:get_user(user_id=d9586b808f424d84881b2efb78ae761f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:20.417776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac047b-840f-4814-828c-67c129a995e8 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:20.417776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 85/162] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:19 2022] GET /identity/v3/users/d9586b808f424d84881b2efb78ae761f => generated 275 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:20.418385 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac047b-840f-4814-828c-67c129a995e8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:20.508349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be2182-6474-4027-bcee-61cf813b826c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:20.557499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128206f8-6f61-40ad-bde9-7bf8e85e800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:20.558752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128206f8-6f61-40ad-bde9-7bf8e85e800d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:20.559233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128206f8-6f61-40ad-bde9-7bf8e85e800d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:20.559758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128206f8-6f61-40ad-bde9-7bf8e85e800d None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:20.561205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128206f8-6f61-40ad-bde9-7bf8e85e800d None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:20.563195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128206f8-6f61-40ad-bde9-7bf8e85e800d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:20.568282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 78/163] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:20 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:20.569368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128206f8-6f61-40ad-bde9-7bf8e85e800d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:20.611100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:20.727883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128206f8-6f61-40ad-bde9-7bf8e85e800d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:20.753417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac047b-840f-4814-828c-67c129a995e8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:20.776442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31545b73-62d5-4f53-ae15-713bfc466b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:20.777437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31545b73-62d5-4f53-ae15-713bfc466b6d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:20.778183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31545b73-62d5-4f53-ae15-713bfc466b6d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:20.780219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31545b73-62d5-4f53-ae15-713bfc466b6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:20.836914 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5d2d6-647d-4f68-be24-9f725e6ff7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:20.838094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5d2d6-647d-4f68-be24-9f725e6ff7d7 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:20.838589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5d2d6-647d-4f68-be24-9f725e6ff7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:20.839154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5d2d6-647d-4f68-be24-9f725e6ff7d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:20.863327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5d2d6-647d-4f68-be24-9f725e6ff7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-dab5d2d6-647d-4f68-be24-9f725e6ff7d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:20.883980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:20.884904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:20.885661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 86/164] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:20.886562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93564f-f3dc-4a42-8536-8b46c2b28eab None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:20.887008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93564f-f3dc-4a42-8536-8b46c2b28eab None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:20.895686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93564f-f3dc-4a42-8536-8b46c2b28eab None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:20.897622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 87/165] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:20 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:20.898578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93564f-f3dc-4a42-8536-8b46c2b28eab None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:20.902311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:20.922763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31545b73-62d5-4f53-ae15-713bfc466b6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:20.925900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31545b73-62d5-4f53-ae15-713bfc466b6d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:20.964737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:21.067406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 79/166] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:21.068585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31545b73-62d5-4f53-ae15-713bfc466b6d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:21.192054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31545b73-62d5-4f53-ae15-713bfc466b6d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:21.227758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:21.231298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093241d5-6623-43b1-91f9-700f30e23912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:21.232229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093241d5-6623-43b1-91f9-700f30e23912 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:21.232731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093241d5-6623-43b1-91f9-700f30e23912 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:21.233227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093241d5-6623-43b1-91f9-700f30e23912 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:21.236551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093241d5-6623-43b1-91f9-700f30e23912 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:21.237087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093241d5-6623-43b1-91f9-700f30e23912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:21.238663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093241d5-6623-43b1-91f9-700f30e23912 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:21.249108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 80/167] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:21.252453 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d356f-91b8-4ec1-9974-5f3d5985da84 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:21.253225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d356f-91b8-4ec1-9974-5f3d5985da84 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:21.253702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d356f-91b8-4ec1-9974-5f3d5985da84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:21.272270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ed6d356f-91b8-4ec1-9974-5f3d5985da84 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:21.273786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ed6d356f-91b8-4ec1-9974-5f3d5985da84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:21.304066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93564f-f3dc-4a42-8536-8b46c2b28eab None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:21.377302 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21f40-90de-4f1a-96d5-b57a47052187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:21.378301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21f40-90de-4f1a-96d5-b57a47052187 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:21.379873 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21f40-90de-4f1a-96d5-b57a47052187 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:21.380371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21f40-90de-4f1a-96d5-b57a47052187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:21.383547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21f40-90de-4f1a-96d5-b57a47052187 None admin] RBAC: Adding query filter params (role.id=0b03acccb970430e8e3b5a7921cb70d0, scope.project.id=82e4708d10bd4a56b8c263303c8beb29, user.id=d9586b808f424d84881b2efb78ae761f) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:21.384153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21f40-90de-4f1a-96d5-b57a47052187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:21.387733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21f40-90de-4f1a-96d5-b57a47052187 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:21.389394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 81/168] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:21.392211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d356f-91b8-4ec1-9974-5f3d5985da84 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:21.404216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 88/169] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:20 2022] GET /identity/v3/role_assignments?user.id=d9586b808f424d84881b2efb78ae761f&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 608 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:21.405385 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21f40-90de-4f1a-96d5-b57a47052187 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:21.602310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:21.655462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d356f-91b8-4ec1-9974-5f3d5985da84 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:21.661233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21f40-90de-4f1a-96d5-b57a47052187 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:21.675627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:21.752416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221ebae-d20d-439b-bad3-7a4842cf2c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:21.753239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e97fda-9aa6-4688-a1c1-505bbece9e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:21.753570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221ebae-d20d-439b-bad3-7a4842cf2c02 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:21.753999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221ebae-d20d-439b-bad3-7a4842cf2c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:21.754117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221ebae-d20d-439b-bad3-7a4842cf2c02 None admin] PATH_INFO: `/v3/users/3053220009774402bf42e0fd6204d7fa` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:21.755003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e97fda-9aa6-4688-a1c1-505bbece9e7e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:21.755394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221ebae-d20d-439b-bad3-7a4842cf2c02 None admin] RBAC: Authorizing `identity:get_user(user_id=3053220009774402bf42e0fd6204d7fa)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:21.755512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e97fda-9aa6-4688-a1c1-505bbece9e7e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:21.755790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e97fda-9aa6-4688-a1c1-505bbece9e7e None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:21.757273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221ebae-d20d-439b-bad3-7a4842cf2c02 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:21.760085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e97fda-9aa6-4688-a1c1-505bbece9e7e None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:21.761727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e97fda-9aa6-4688-a1c1-505bbece9e7e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:21.762338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 89/170] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:21 2022] GET /identity/v3/users/3053220009774402bf42e0fd6204d7fa => generated 289 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:21.763323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221ebae-d20d-439b-bad3-7a4842cf2c02 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:21.764436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 82/171] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:21 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:21.770824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e97fda-9aa6-4688-a1c1-505bbece9e7e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:21.916442 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221ebae-d20d-439b-bad3-7a4842cf2c02 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:21.998533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e97fda-9aa6-4688-a1c1-505bbece9e7e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:22.029897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a66d8-6021-4768-8ed8-c4bcd8fc2383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:22.031978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a66d8-6021-4768-8ed8-c4bcd8fc2383 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.032406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a66d8-6021-4768-8ed8-c4bcd8fc2383 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.032845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a66d8-6021-4768-8ed8-c4bcd8fc2383 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.045059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:22.049152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec0d93-0793-4559-a60b-73b0fe1c9157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:22.051897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec0d93-0793-4559-a60b-73b0fe1c9157 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.052355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec0d93-0793-4559-a60b-73b0fe1c9157 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.052800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec0d93-0793-4559-a60b-73b0fe1c9157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.054063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec0d93-0793-4559-a60b-73b0fe1c9157 None admin] RBAC: Adding query filter params (role.id=3ef6518e7cfb491dab86c245c0aeac21, scope.project.id=82e4708d10bd4a56b8c263303c8beb29, user.id=d9586b808f424d84881b2efb78ae761f) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:22.054515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec0d93-0793-4559-a60b-73b0fe1c9157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:22.056181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec0d93-0793-4559-a60b-73b0fe1c9157 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:22.063752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 83/172] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:21 2022] GET /identity/v3/role_assignments?user.id=d9586b808f424d84881b2efb78ae761f&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=3ef6518e7cfb491dab86c245c0aeac21 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:22.064885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec0d93-0793-4559-a60b-73b0fe1c9157 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:22.090904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a66d8-6021-4768-8ed8-c4bcd8fc2383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-548a66d8-6021-4768-8ed8-c4bcd8fc2383 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:22.108346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:22.109433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:22.110211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:22.112849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 90/173] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:22.124427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a66d8-6021-4768-8ed8-c4bcd8fc2383 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:22.147022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:22.240713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec0d93-0793-4559-a60b-73b0fe1c9157 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:22.300501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798080-b9b4-4c2b-b21f-ee277084d627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:22.301582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798080-b9b4-4c2b-b21f-ee277084d627 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.302214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798080-b9b4-4c2b-b21f-ee277084d627 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.302496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798080-b9b4-4c2b-b21f-ee277084d627 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.303854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798080-b9b4-4c2b-b21f-ee277084d627 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:22.305355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798080-b9b4-4c2b-b21f-ee277084d627 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:22.308292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 84/174] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:22 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:22.309732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d501c4-2d2f-4ce9-bbb5-a7818d2dbeaa None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.310059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d501c4-2d2f-4ce9-bbb5-a7818d2dbeaa None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.310380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d501c4-2d2f-4ce9-bbb5-a7818d2dbeaa None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.311794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 85/175] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:22.313788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb748c-46f8-495d-9015-97ad04eabca7 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.314084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb748c-46f8-495d-9015-97ad04eabca7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.314364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb748c-46f8-495d-9015-97ad04eabca7 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.315680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 86/176] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:22.318921 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb748c-46f8-495d-9015-97ad04eabca7 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:22.336255 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a66d8-6021-4768-8ed8-c4bcd8fc2383 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:22.395376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae01fb7-3b18-4fc7-a2a7-c5b3d936080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:22.395376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae01fb7-3b18-4fc7-a2a7-c5b3d936080a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.395376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae01fb7-3b18-4fc7-a2a7-c5b3d936080a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.400568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae01fb7-3b18-4fc7-a2a7-c5b3d936080a None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.400568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae01fb7-3b18-4fc7-a2a7-c5b3d936080a None admin] RBAC: Adding query filter params (name=member) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:22.400568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae01fb7-3b18-4fc7-a2a7-c5b3d936080a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:22.400568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae01fb7-3b18-4fc7-a2a7-c5b3d936080a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:22.411278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 91/177] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:22.418176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900828b-0daf-411b-a561-928e17591b1b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.418176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900828b-0daf-411b-a561-928e17591b1b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.418176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900828b-0daf-411b-a561-928e17591b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.479091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-9900828b-0daf-411b-a561-928e17591b1b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:22.480652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9900828b-0daf-411b-a561-928e17591b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:22.499167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb748c-46f8-495d-9015-97ad04eabca7 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:22.509888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:22.535034 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:22.538153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7936b-4aca-4ac0-8f2e-542edb0c903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:22.538153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7936b-4aca-4ac0-8f2e-542edb0c903a None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.538153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7936b-4aca-4ac0-8f2e-542edb0c903a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.538398 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7936b-4aca-4ac0-8f2e-542edb0c903a None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29/users/3053220009774402bf42e0fd6204d7fa/roles/9ee3b802458741a6be937b8b8dcdc3f6` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.540585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7936b-4aca-4ac0-8f2e-542edb0c903a None admin] RBAC: Authorizing `identity:create_grant(project_id=82e4708d10bd4a56b8c263303c8beb29, user_id=3053220009774402bf42e0fd6204d7fa, role_id=9ee3b802458741a6be937b8b8dcdc3f6)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:22.542018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7936b-4aca-4ac0-8f2e-542edb0c903a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:22.553044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 92/178] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:22.554528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22415b-c7f8-4920-83a4-4eb296ed6c80 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.554823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22415b-c7f8-4920-83a4-4eb296ed6c80 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.555105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22415b-c7f8-4920-83a4-4eb296ed6c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.572731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-5a22415b-c7f8-4920-83a4-4eb296ed6c80 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:22.574041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-5a22415b-c7f8-4920-83a4-4eb296ed6c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:22.631654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 87/179] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:32:22 2022] PUT /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29/users/3053220009774402bf42e0fd6204d7fa/roles/9ee3b802458741a6be937b8b8dcdc3f6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:22.633392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7936b-4aca-4ac0-8f2e-542edb0c903a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:22.650252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 93/180] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:22.652606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98c4d-b41d-4769-8b77-68382b23fe16 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.652606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98c4d-b41d-4769-8b77-68382b23fe16 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.652606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98c4d-b41d-4769-8b77-68382b23fe16 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.654399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 94/181] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:22.659951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98c4d-b41d-4769-8b77-68382b23fe16 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:22.783561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7936b-4aca-4ac0-8f2e-542edb0c903a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:22.813593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98c4d-b41d-4769-8b77-68382b23fe16 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:22.837193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4754d-ff1c-4d44-988a-3d6f3d200a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:22.837575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:22.839283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4754d-ff1c-4d44-988a-3d6f3d200a43 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.839887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4754d-ff1c-4d44-988a-3d6f3d200a43 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.840316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4754d-ff1c-4d44-988a-3d6f3d200a43 None admin] PATH_INFO: `/v3/users/d9586b808f424d84881b2efb78ae761f` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.842705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4754d-ff1c-4d44-988a-3d6f3d200a43 None admin] RBAC: Authorizing `identity:get_user(user_id=d9586b808f424d84881b2efb78ae761f)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:22.845227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4754d-ff1c-4d44-988a-3d6f3d200a43 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:22.847014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 88/182] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:22 2022] GET /identity/v3/users/d9586b808f424d84881b2efb78ae761f => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:22.851381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786850db-6e4f-42e2-8c02-9ac9f9eadd9f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.851381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786850db-6e4f-42e2-8c02-9ac9f9eadd9f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.851381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786850db-6e4f-42e2-8c02-9ac9f9eadd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.860569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443a90a-4ed9-4a98-acc0-2ee933133f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:22.861591 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443a90a-4ed9-4a98-acc0-2ee933133f83 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:22.861875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443a90a-4ed9-4a98-acc0-2ee933133f83 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:22.862643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443a90a-4ed9-4a98-acc0-2ee933133f83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:22.863879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443a90a-4ed9-4a98-acc0-2ee933133f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:22.866047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443a90a-4ed9-4a98-acc0-2ee933133f83 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:22.868103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-786850db-6e4f-42e2-8c02-9ac9f9eadd9f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:22.869290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-786850db-6e4f-42e2-8c02-9ac9f9eadd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:22.869700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 95/183] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:32:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:22.870741 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443a90a-4ed9-4a98-acc0-2ee933133f83 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:22.911756 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:22.970921 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 89/184] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:22.973465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786850db-6e4f-42e2-8c02-9ac9f9eadd9f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:23.007520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443a90a-4ed9-4a98-acc0-2ee933133f83 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:23.050273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf278c2b-6221-4626-a8f5-eb7fa35a1a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:23.051203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf278c2b-6221-4626-a8f5-eb7fa35a1a5e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:23.051590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf278c2b-6221-4626-a8f5-eb7fa35a1a5e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:23.051981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf278c2b-6221-4626-a8f5-eb7fa35a1a5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:23.064183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf278c2b-6221-4626-a8f5-eb7fa35a1a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-cf278c2b-6221-4626-a8f5-eb7fa35a1a5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:23.072665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:23.073663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:23.074449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 96/185] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:32:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:23.075111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf278c2b-6221-4626-a8f5-eb7fa35a1a5e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:23.118576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786850db-6e4f-42e2-8c02-9ac9f9eadd9f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:23.146962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:23.161979 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dec862-cfb7-4e29-afa1-8440cf7c20bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:23.162920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dec862-cfb7-4e29-afa1-8440cf7c20bd None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:23.163325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dec862-cfb7-4e29-afa1-8440cf7c20bd None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:23.163975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dec862-cfb7-4e29-afa1-8440cf7c20bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:23.205162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:23.217997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf278c2b-6221-4626-a8f5-eb7fa35a1a5e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:23.246797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dec862-cfb7-4e29-afa1-8440cf7c20bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:23.248562 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dec862-cfb7-4e29-afa1-8440cf7c20bd None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:23.263313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aae89-88f5-4501-a05b-557484ebbdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:23.264861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aae89-88f5-4501-a05b-557484ebbdaa None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:23.265415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aae89-88f5-4501-a05b-557484ebbdaa None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:23.266650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aae89-88f5-4501-a05b-557484ebbdaa None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:23.267956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aae89-88f5-4501-a05b-557484ebbdaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:23.269990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6aae89-88f5-4501-a05b-557484ebbdaa None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:23.368764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 90/186] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:23.368764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dec862-cfb7-4e29-afa1-8440cf7c20bd None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:23.395393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 97/187] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:32:23 2022] POST /identity/v3/users => generated 297 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:32:23.403629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aae89-88f5-4501-a05b-557484ebbdaa None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:23.468712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:23.545015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dec862-cfb7-4e29-afa1-8440cf7c20bd None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:23.594590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:23.601435 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aae89-88f5-4501-a05b-557484ebbdaa None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:23.620099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949a9c7-d223-47a4-a55f-0b31a6a0b0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:23.622258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949a9c7-d223-47a4-a55f-0b31a6a0b0f6 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:23.622258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949a9c7-d223-47a4-a55f-0b31a6a0b0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:23.622258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949a9c7-d223-47a4-a55f-0b31a6a0b0f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:23.641267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949a9c7-d223-47a4-a55f-0b31a6a0b0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-3949a9c7-d223-47a4-a55f-0b31a6a0b0f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:23.651499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:23.652459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:23.653234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:23.654918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 91/188] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:23.659397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949a9c7-d223-47a4-a55f-0b31a6a0b0f6 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:23.671718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2a17d-7ccd-42cd-868c-d3bfca70cb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:23.672919 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a17d-7ccd-42cd-868c-d3bfca70cb04 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:23.674570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a17d-7ccd-42cd-868c-d3bfca70cb04 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:23.675713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a17d-7ccd-42cd-868c-d3bfca70cb04 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:23.676897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2a17d-7ccd-42cd-868c-d3bfca70cb04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:23.678511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2a17d-7ccd-42cd-868c-d3bfca70cb04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:23.678619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2a17d-7ccd-42cd-868c-d3bfca70cb04 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:23.692604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 98/189] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:23.694404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2a17d-7ccd-42cd-868c-d3bfca70cb04 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:23.850698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949a9c7-d223-47a4-a55f-0b31a6a0b0f6 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:23.879024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2a17d-7ccd-42cd-868c-d3bfca70cb04 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:23.890835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:23.909274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3107cf-9768-4b68-9d23-18dd0893ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:23.910218 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3107cf-9768-4b68-9d23-18dd0893ff14 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:23.910503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3107cf-9768-4b68-9d23-18dd0893ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:23.910818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3107cf-9768-4b68-9d23-18dd0893ff14 None admin] PATH_INFO: `/v3/projects/20842153d694444a83d8a97124b7842f` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:23.912840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3107cf-9768-4b68-9d23-18dd0893ff14 None admin] RBAC: Authorizing `identity:get_project(project_id=20842153d694444a83d8a97124b7842f)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:23.914301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3107cf-9768-4b68-9d23-18dd0893ff14 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:23.916133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 92/190] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:23 2022] GET /identity/v3/projects/20842153d694444a83d8a97124b7842f => generated 312 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:23.923399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3107cf-9768-4b68-9d23-18dd0893ff14 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:23.936767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698bf63-bd9f-4714-bee7-1821d22f906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:23.937698 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698bf63-bd9f-4714-bee7-1821d22f906e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:23.938045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698bf63-bd9f-4714-bee7-1821d22f906e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:23.938740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698bf63-bd9f-4714-bee7-1821d22f906e None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:23.943088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698bf63-bd9f-4714-bee7-1821d22f906e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:23.943088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698bf63-bd9f-4714-bee7-1821d22f906e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:23.943088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698bf63-bd9f-4714-bee7-1821d22f906e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:23.970056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 99/191] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:23.970993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698bf63-bd9f-4714-bee7-1821d22f906e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:24.022942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:24.125725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3107cf-9768-4b68-9d23-18dd0893ff14 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:24.182267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698bf63-bd9f-4714-bee7-1821d22f906e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:24.199925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b56c5e-4831-4740-8fcd-55b409bc7924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:24.201063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b56c5e-4831-4740-8fcd-55b409bc7924 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:24.201341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b56c5e-4831-4740-8fcd-55b409bc7924 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:24.202186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b56c5e-4831-4740-8fcd-55b409bc7924 None admin] PATH_INFO: `/v3/users/6200a2a1841549a9ac633b1afc17dd1a` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:24.228544 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b56c5e-4831-4740-8fcd-55b409bc7924 None admin] RBAC: Authorizing `identity:get_user(user_id=6200a2a1841549a9ac633b1afc17dd1a)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:24.232197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b56c5e-4831-4740-8fcd-55b409bc7924 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:24.236073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 93/192] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:23 2022] GET /identity/v3/users/6200a2a1841549a9ac633b1afc17dd1a => generated 283 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:24.238304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b56c5e-4831-4740-8fcd-55b409bc7924 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:24.259673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bed7dc-f0c5-4e2a-ab33-c561b9dce50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:24.260385 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed7dc-f0c5-4e2a-ab33-c561b9dce50f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:24.260667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed7dc-f0c5-4e2a-ab33-c561b9dce50f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:24.260996 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed7dc-f0c5-4e2a-ab33-c561b9dce50f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:24.261832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bed7dc-f0c5-4e2a-ab33-c561b9dce50f None admin] RBAC: Adding query filter params (role.id=0b03acccb970430e8e3b5a7921cb70d0, scope.project.id=20842153d694444a83d8a97124b7842f, user.id=d9586b808f424d84881b2efb78ae761f) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:24.262145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bed7dc-f0c5-4e2a-ab33-c561b9dce50f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:24.265550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bed7dc-f0c5-4e2a-ab33-c561b9dce50f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:24.285356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 100/193] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:23 2022] GET /identity/v3/role_assignments?user.id=d9586b808f424d84881b2efb78ae761f&scope.project.id=20842153d694444a83d8a97124b7842f&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:24.287534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bed7dc-f0c5-4e2a-ab33-c561b9dce50f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:24.378522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:24.417371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:24.433356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bed7dc-f0c5-4e2a-ab33-c561b9dce50f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:24.495263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02904ba0-10f0-4f71-bf31-ff56d9d60b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:24.495966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904ba0-10f0-4f71-bf31-ff56d9d60b62 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:24.496248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904ba0-10f0-4f71-bf31-ff56d9d60b62 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:24.496523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02904ba0-10f0-4f71-bf31-ff56d9d60b62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:24.542449 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b56c5e-4831-4740-8fcd-55b409bc7924 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:24.644504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6529-f80a-417f-8611-75c61b90c942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:24.645394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6529-f80a-417f-8611-75c61b90c942 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:24.645681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6529-f80a-417f-8611-75c61b90c942 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:24.645959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6529-f80a-417f-8611-75c61b90c942 None admin] PATH_INFO: `/v3/users/6200a2a1841549a9ac633b1afc17dd1a` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:24.652948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6529-f80a-417f-8611-75c61b90c942 None admin] RBAC: Authorizing `identity:get_user(user_id=6200a2a1841549a9ac633b1afc17dd1a)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:24.655910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6529-f80a-417f-8611-75c61b90c942 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:24.658367 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 94/194] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:24 2022] GET /identity/v3/users/6200a2a1841549a9ac633b1afc17dd1a => generated 283 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:24.663883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6529-f80a-417f-8611-75c61b90c942 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:24.686900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02904ba0-10f0-4f71-bf31-ff56d9d60b62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:24.690899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02904ba0-10f0-4f71-bf31-ff56d9d60b62 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:24.875533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:24.889796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6529-f80a-417f-8611-75c61b90c942 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:24.905601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 101/195] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:24.912403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02904ba0-10f0-4f71-bf31-ff56d9d60b62 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:24.933072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:24.966275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179130e5-a022-4afb-b370-fb45890369ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:24.966919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179130e5-a022-4afb-b370-fb45890369ee None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:24.967208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179130e5-a022-4afb-b370-fb45890369ee None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:24.967515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179130e5-a022-4afb-b370-fb45890369ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:25.118964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179130e5-a022-4afb-b370-fb45890369ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:25.127079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02904ba0-10f0-4f71-bf31-ff56d9d60b62 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:25.128723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179130e5-a022-4afb-b370-fb45890369ee None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:25.186854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb368da0-09d5-468a-93c9-c55913bb1299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:25.190472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb368da0-09d5-468a-93c9-c55913bb1299 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:25.190749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb368da0-09d5-468a-93c9-c55913bb1299 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:25.191380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb368da0-09d5-468a-93c9-c55913bb1299 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:25.195182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb368da0-09d5-468a-93c9-c55913bb1299 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:25.196699 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb368da0-09d5-468a-93c9-c55913bb1299 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:25.198658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 102/196] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:24 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:25.206063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb368da0-09d5-468a-93c9-c55913bb1299 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:25.322132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:25.335043 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 95/197] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:25.336638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105347f-12db-44d1-bcf3-4d89a3786a50 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:25.337059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105347f-12db-44d1-bcf3-4d89a3786a50 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:25.337463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105347f-12db-44d1-bcf3-4d89a3786a50 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:25.338853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 96/198] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:25.349289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105347f-12db-44d1-bcf3-4d89a3786a50 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:25.389093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:25.396976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb368da0-09d5-468a-93c9-c55913bb1299 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:25.464519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c4022-c034-441c-bcfd-d4fcaa951c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:25.465429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c4022-c034-441c-bcfd-d4fcaa951c6c None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:25.465559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c4022-c034-441c-bcfd-d4fcaa951c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:25.465727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c4022-c034-441c-bcfd-d4fcaa951c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:25.466558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c4022-c034-441c-bcfd-d4fcaa951c6c None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf, user.id=6200a2a1841549a9ac633b1afc17dd1a) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:25.466919 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c4022-c034-441c-bcfd-d4fcaa951c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:25.469881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c4022-c034-441c-bcfd-d4fcaa951c6c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:25.478076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 103/199] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:25 2022] GET /identity/v3/role_assignments?user.id=6200a2a1841549a9ac633b1afc17dd1a&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:25.481153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c440ca0-1e17-4237-b96a-0d5456eb8375 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:25.481153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c440ca0-1e17-4237-b96a-0d5456eb8375 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:25.481153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c440ca0-1e17-4237-b96a-0d5456eb8375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:25.512796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-2c440ca0-1e17-4237-b96a-0d5456eb8375 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:25.514013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2c440ca0-1e17-4237-b96a-0d5456eb8375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:25.545220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105347f-12db-44d1-bcf3-4d89a3786a50 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:25.623815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95beac2-d92d-4f4c-8e86-ccd7e2ced5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:25.626611 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95beac2-d92d-4f4c-8e86-ccd7e2ced5a3 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:25.626611 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95beac2-d92d-4f4c-8e86-ccd7e2ced5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:25.626611 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95beac2-d92d-4f4c-8e86-ccd7e2ced5a3 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:25.629372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95beac2-d92d-4f4c-8e86-ccd7e2ced5a3 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:25.632797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95beac2-d92d-4f4c-8e86-ccd7e2ced5a3 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:25.640009 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 97/200] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:25 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:25.648294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95beac2-d92d-4f4c-8e86-ccd7e2ced5a3 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:25.670411 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 104/201] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:25.725043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c440ca0-1e17-4237-b96a-0d5456eb8375 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:25.789053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:25.800801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:25.822739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95beac2-d92d-4f4c-8e86-ccd7e2ced5a3 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:25.868539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c440ca0-1e17-4237-b96a-0d5456eb8375 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:25.878040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce0ed3-8546-4212-8fcc-c9c8d4165980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:25.878646 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce0ed3-8546-4212-8fcc-c9c8d4165980 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:25.878931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce0ed3-8546-4212-8fcc-c9c8d4165980 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:25.879207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce0ed3-8546-4212-8fcc-c9c8d4165980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:25.880079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce0ed3-8546-4212-8fcc-c9c8d4165980 None admin] RBAC: Adding query filter params (role.id=3ef6518e7cfb491dab86c245c0aeac21, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf, user.id=6200a2a1841549a9ac633b1afc17dd1a) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:25.880398 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce0ed3-8546-4212-8fcc-c9c8d4165980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:25.881862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce0ed3-8546-4212-8fcc-c9c8d4165980 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:25.896243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 98/202] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:25 2022] GET /identity/v3/role_assignments?user.id=6200a2a1841549a9ac633b1afc17dd1a&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=3ef6518e7cfb491dab86c245c0aeac21 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:25.975870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487da13-61d5-4d42-a604-bd054ff4c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:25.975870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487da13-61d5-4d42-a604-bd054ff4c00b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:25.975870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487da13-61d5-4d42-a604-bd054ff4c00b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:25.975870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487da13-61d5-4d42-a604-bd054ff4c00b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:26.012451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487da13-61d5-4d42-a604-bd054ff4c00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-7487da13-61d5-4d42-a604-bd054ff4c00b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:26.021048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:26.022046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:26.022822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 105/203] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:26.030021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce0ed3-8546-4212-8fcc-c9c8d4165980 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:26.203824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce0ed3-8546-4212-8fcc-c9c8d4165980 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:26.249325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bb140-8399-4230-b962-419f3ab61ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:26.250057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb140-8399-4230-b962-419f3ab61ce1 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:26.250345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb140-8399-4230-b962-419f3ab61ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:26.250625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb140-8399-4230-b962-419f3ab61ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:26.251430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bb140-8399-4230-b962-419f3ab61ce1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:26.251747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bb140-8399-4230-b962-419f3ab61ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:26.253209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bb140-8399-4230-b962-419f3ab61ce1 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:26.267562 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 99/204] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:26.280541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487da13-61d5-4d42-a604-bd054ff4c00b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:26.313262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2182c6-1d38-4814-8978-b909301b606c None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:26.313580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2182c6-1d38-4814-8978-b909301b606c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:26.313826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2182c6-1d38-4814-8978-b909301b606c None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:26.315214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 100/205] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:32:26.320787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c40a-c844-4a96-8ca1-8f28587e2d2c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:26.321066 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c40a-c844-4a96-8ca1-8f28587e2d2c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:26.321358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c40a-c844-4a96-8ca1-8f28587e2d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:26.371282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f647c40a-c844-4a96-8ca1-8f28587e2d2c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:26.375432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f647c40a-c844-4a96-8ca1-8f28587e2d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:26.393591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:26.414747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487da13-61d5-4d42-a604-bd054ff4c00b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:26.425769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:26.485645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be49c7-cd2e-4e27-9725-b8316637e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:26.486559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be49c7-cd2e-4e27-9725-b8316637e123 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:26.486845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be49c7-cd2e-4e27-9725-b8316637e123 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:26.487125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be49c7-cd2e-4e27-9725-b8316637e123 None admin] PATH_INFO: `/v3/users/3053220009774402bf42e0fd6204d7fa` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:26.489323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be49c7-cd2e-4e27-9725-b8316637e123 None admin] RBAC: Authorizing `identity:get_user(user_id=3053220009774402bf42e0fd6204d7fa)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:26.490934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 101/206] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:26.496442 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be49c7-cd2e-4e27-9725-b8316637e123 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:26.496598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4e946-a8da-4e58-bcf5-b92704a9a941 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:26.496598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4e946-a8da-4e58-bcf5-b92704a9a941 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:26.496598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4e946-a8da-4e58-bcf5-b92704a9a941 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:26.496784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 106/207] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:26 2022] GET /identity/v3/users/3053220009774402bf42e0fd6204d7fa => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:26.496864 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 102/208] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:26.507231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be49c7-cd2e-4e27-9725-b8316637e123 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:26.519371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9a798-d379-4eb8-8e43-57cf62707d43 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:26.519371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9a798-d379-4eb8-8e43-57cf62707d43 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:26.519371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9a798-d379-4eb8-8e43-57cf62707d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:26.546703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-15e9a798-d379-4eb8-8e43-57cf62707d43 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:26.549246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-15e9a798-d379-4eb8-8e43-57cf62707d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:26.661722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 103/209] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:26.666752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be49c7-cd2e-4e27-9725-b8316637e123 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:26.668296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9a798-d379-4eb8-8e43-57cf62707d43 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:26.711409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c962-f46f-4cf5-b9a6-75166852c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:26.712541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c962-f46f-4cf5-b9a6-75166852c039 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:26.713020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c962-f46f-4cf5-b9a6-75166852c039 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:26.713750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06c962-f46f-4cf5-b9a6-75166852c039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:26.766903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:26.789524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c962-f46f-4cf5-b9a6-75166852c039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:26.790162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:26.791736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06c962-f46f-4cf5-b9a6-75166852c039 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:26.821120 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9a798-d379-4eb8-8e43-57cf62707d43 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:26.875823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efafff-7425-416b-92b6-b316ba3ac8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:26.876681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efafff-7425-416b-92b6-b316ba3ac8e9 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:26.876964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efafff-7425-416b-92b6-b316ba3ac8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:26.877242 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efafff-7425-416b-92b6-b316ba3ac8e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:26.890151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efafff-7425-416b-92b6-b316ba3ac8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-a0efafff-7425-416b-92b6-b316ba3ac8e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:26.900124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:26.901024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:26.901796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 104/210] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:26.908550 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efafff-7425-416b-92b6-b316ba3ac8e9 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:26.927836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 107/211] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:26.929000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c962-f46f-4cf5-b9a6-75166852c039 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:27.049434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:27.078857 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efafff-7425-416b-92b6-b316ba3ac8e9 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:27.112485 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06c962-f46f-4cf5-b9a6-75166852c039 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:27.139725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628c858-e24e-44b6-8fa0-4257f3bb3295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:27.141002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628c858-e24e-44b6-8fa0-4257f3bb3295 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:27.141430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628c858-e24e-44b6-8fa0-4257f3bb3295 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:27.141869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628c858-e24e-44b6-8fa0-4257f3bb3295 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:27.143371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628c858-e24e-44b6-8fa0-4257f3bb3295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:27.145075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628c858-e24e-44b6-8fa0-4257f3bb3295 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:27.149312 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 105/212] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:32:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:27.157491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628c858-e24e-44b6-8fa0-4257f3bb3295 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:27.160793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:27.182592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068903-6f02-4130-b8f5-236d9f9b955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:27.184372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068903-6f02-4130-b8f5-236d9f9b955b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:27.184372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068903-6f02-4130-b8f5-236d9f9b955b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:27.184372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068903-6f02-4130-b8f5-236d9f9b955b None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:27.187300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5068903-6f02-4130-b8f5-236d9f9b955b None admin] RBAC: Adding query filter params (name=member) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:27.188197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5068903-6f02-4130-b8f5-236d9f9b955b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:27.190967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5068903-6f02-4130-b8f5-236d9f9b955b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:27.208279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 108/213] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:27.209080 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068903-6f02-4130-b8f5-236d9f9b955b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:27.282605 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628c858-e24e-44b6-8fa0-4257f3bb3295 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:27.325597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1362e89-7556-444b-8e7e-1b1409d82783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:27.327068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1362e89-7556-444b-8e7e-1b1409d82783 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:27.327581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1362e89-7556-444b-8e7e-1b1409d82783 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:27.328700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1362e89-7556-444b-8e7e-1b1409d82783 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:27.330102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1362e89-7556-444b-8e7e-1b1409d82783 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:27.331815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1362e89-7556-444b-8e7e-1b1409d82783 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:27.334732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 106/214] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:27 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:27.342250 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1362e89-7556-444b-8e7e-1b1409d82783 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:27.415503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068903-6f02-4130-b8f5-236d9f9b955b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:27.441127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:27.477335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1362e89-7556-444b-8e7e-1b1409d82783 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:27.514051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc286828-50bd-48a1-850e-8751e8b602ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:27.515820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc286828-50bd-48a1-850e-8751e8b602ed None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:27.516287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc286828-50bd-48a1-850e-8751e8b602ed None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:27.516739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc286828-50bd-48a1-850e-8751e8b602ed None admin] PATH_INFO: `/v3/users/463b7bf567d14d1894ad2f1807a34cdd` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:27.518999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14528c3-ff4d-450a-8fba-21036a7b5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:27.520572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14528c3-ff4d-450a-8fba-21036a7b5b26 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:27.521725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14528c3-ff4d-450a-8fba-21036a7b5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:27.522863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14528c3-ff4d-450a-8fba-21036a7b5b26 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:27.523758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14528c3-ff4d-450a-8fba-21036a7b5b26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:27.526211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14528c3-ff4d-450a-8fba-21036a7b5b26 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:27.539250 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc286828-50bd-48a1-850e-8751e8b602ed None admin] RBAC: Authorizing `identity:get_user(user_id=463b7bf567d14d1894ad2f1807a34cdd)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:27.540952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc286828-50bd-48a1-850e-8751e8b602ed None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:27.544127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 107/215] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:27 2022] GET /identity/v3/users/463b7bf567d14d1894ad2f1807a34cdd => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:27.545182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc286828-50bd-48a1-850e-8751e8b602ed None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:27.547111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:27.665618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc286828-50bd-48a1-850e-8751e8b602ed None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:27.682966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 109/216] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:32:27 2022] POST /identity/v3/users => generated 297 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:32:27.692447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14528c3-ff4d-450a-8fba-21036a7b5b26 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:27.754969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:27.779275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0524f-b9de-47a7-bb1e-e715a1464b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:27.780285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0524f-b9de-47a7-bb1e-e715a1464b07 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:27.780564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0524f-b9de-47a7-bb1e-e715a1464b07 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:27.781623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0524f-b9de-47a7-bb1e-e715a1464b07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:27.783898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0524f-b9de-47a7-bb1e-e715a1464b07 None admin] RBAC: Adding query filter params (role.id=9ee3b802458741a6be937b8b8dcdc3f6, scope.project.id=82e4708d10bd4a56b8c263303c8beb29, user.id=3053220009774402bf42e0fd6204d7fa) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:27.784251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0524f-b9de-47a7-bb1e-e715a1464b07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:27.791561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0524f-b9de-47a7-bb1e-e715a1464b07 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:27.799291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 108/217] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:27 2022] GET /identity/v3/role_assignments?user.id=3053220009774402bf42e0fd6204d7fa&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=9ee3b802458741a6be937b8b8dcdc3f6 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:27.961906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14528c3-ff4d-450a-8fba-21036a7b5b26 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:28.041666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0625c4d-7440-454f-93c5-55d1cf7b4c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:28.042822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0625c4d-7440-454f-93c5-55d1cf7b4c3b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:28.044007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0625c4d-7440-454f-93c5-55d1cf7b4c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:28.044500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0625c4d-7440-454f-93c5-55d1cf7b4c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:28.109927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4fde1-587c-484c-8112-9500233a9d1e None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:28.110270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4fde1-587c-484c-8112-9500233a9d1e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:28.110508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4fde1-587c-484c-8112-9500233a9d1e None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:28.112218 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 109/218] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:32:28.120978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f0510-4dc1-45d8-b18f-2042c9eaa92c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:28.121264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f0510-4dc1-45d8-b18f-2042c9eaa92c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:28.121601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f0510-4dc1-45d8-b18f-2042c9eaa92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:28.123831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:28.138250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0625c4d-7440-454f-93c5-55d1cf7b4c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:28.140991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0625c4d-7440-454f-93c5-55d1cf7b4c3b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:28.158075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-1b9f0510-4dc1-45d8-b18f-2042c9eaa92c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:28.160491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1b9f0510-4dc1-45d8-b18f-2042c9eaa92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:28.309883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 110/219] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:28.310857 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 110/220] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:28.319399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f0510-4dc1-45d8-b18f-2042c9eaa92c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:28.344728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0625c4d-7440-454f-93c5-55d1cf7b4c3b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:28.510678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:28.520717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0625c4d-7440-454f-93c5-55d1cf7b4c3b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:28.545051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f0510-4dc1-45d8-b18f-2042c9eaa92c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:28.576131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:28.596715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f9b78-3290-4cb0-a489-5157b0e8b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:28.597529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f9b78-3290-4cb0-a489-5157b0e8b27f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:28.604264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f9b78-3290-4cb0-a489-5157b0e8b27f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:28.604264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f9b78-3290-4cb0-a489-5157b0e8b27f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:28.604420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f725a-0d3b-4b8e-b620-ab7626ccf3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:28.604420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f725a-0d3b-4b8e-b620-ab7626ccf3a1 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:28.604420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f725a-0d3b-4b8e-b620-ab7626ccf3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:28.604420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f725a-0d3b-4b8e-b620-ab7626ccf3a1 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:28.604675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f725a-0d3b-4b8e-b620-ab7626ccf3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:28.610754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f725a-0d3b-4b8e-b620-ab7626ccf3a1 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:28.623604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 111/221] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:28 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:28.625533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b6076-60a5-449c-9e0f-e4b46deac6b1 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:28.625830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b6076-60a5-449c-9e0f-e4b46deac6b1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:28.626131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b6076-60a5-449c-9e0f-e4b46deac6b1 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:28.627977 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 112/222] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:28.633244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f9b78-3290-4cb0-a489-5157b0e8b27f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:28.635688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b6076-60a5-449c-9e0f-e4b46deac6b1 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-6c0f9b78-3290-4cb0-a489-5157b0e8b27f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:28.671607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:28.672544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:28.673328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:28.680446 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 111/223] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:28.686507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e995bf-6228-44d6-9aaa-21c4713a7c61 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:28.688265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e995bf-6228-44d6-9aaa-21c4713a7c61 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:28.689828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e995bf-6228-44d6-9aaa-21c4713a7c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:28.761301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-51e995bf-6228-44d6-9aaa-21c4713a7c61 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:28.764085 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-51e995bf-6228-44d6-9aaa-21c4713a7c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:29.025937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 112/224] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:29.030640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b6076-60a5-449c-9e0f-e4b46deac6b1 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:29.031464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e995bf-6228-44d6-9aaa-21c4713a7c61 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:29.179217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1af16-a616-4dbd-84af-f244df24316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:29.182353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1af16-a616-4dbd-84af-f244df24316b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:29.183863 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1af16-a616-4dbd-84af-f244df24316b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:29.185340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1af16-a616-4dbd-84af-f244df24316b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:29.190808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1af16-a616-4dbd-84af-f244df24316b None admin] RBAC: Adding query filter params (role.id=0b03acccb970430e8e3b5a7921cb70d0, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf, user.id=463b7bf567d14d1894ad2f1807a34cdd) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:29.192539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1af16-a616-4dbd-84af-f244df24316b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:29.199990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1af16-a616-4dbd-84af-f244df24316b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:29.232019 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 113/225] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:28 2022] GET /identity/v3/role_assignments?user.id=463b7bf567d14d1894ad2f1807a34cdd&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 259 bytes in 602 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:29.237921 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1af16-a616-4dbd-84af-f244df24316b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:29.277947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:29.293945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e995bf-6228-44d6-9aaa-21c4713a7c61 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:29.332722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f8b0f-1261-4016-998a-433ab9bd3dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:29.333654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f8b0f-1261-4016-998a-433ab9bd3dc5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:29.334082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f8b0f-1261-4016-998a-433ab9bd3dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:29.334862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f8b0f-1261-4016-998a-433ab9bd3dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:29.336091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f8b0f-1261-4016-998a-433ab9bd3dc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:29.336550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f8b0f-1261-4016-998a-433ab9bd3dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:29.338463 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f8b0f-1261-4016-998a-433ab9bd3dc5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:29.348481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 113/226] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:29.354970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f8b0f-1261-4016-998a-433ab9bd3dc5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:29.446509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:29.493949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f8b0f-1261-4016-998a-433ab9bd3dc5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:29.502882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1af16-a616-4dbd-84af-f244df24316b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:29.532530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5229d-0ac2-438e-b96b-a206ef16bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:29.533315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5229d-0ac2-438e-b96b-a206ef16bd10 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:29.533756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5229d-0ac2-438e-b96b-a206ef16bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:29.534172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5229d-0ac2-438e-b96b-a206ef16bd10 None admin] PATH_INFO: `/v3/users/6200a2a1841549a9ac633b1afc17dd1a` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:29.535571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5229d-0ac2-438e-b96b-a206ef16bd10 None admin] RBAC: Authorizing `identity:get_user(user_id=6200a2a1841549a9ac633b1afc17dd1a)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:29.537162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5229d-0ac2-438e-b96b-a206ef16bd10 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:29.538948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 114/227] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:29 2022] GET /identity/v3/users/6200a2a1841549a9ac633b1afc17dd1a => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:29.545456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5229d-0ac2-438e-b96b-a206ef16bd10 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:29.561975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db0bf3-35da-4b7e-ab2b-5bc6ac073dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:29.563672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db0bf3-35da-4b7e-ab2b-5bc6ac073dfb None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:29.564095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db0bf3-35da-4b7e-ab2b-5bc6ac073dfb None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:29.565792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db0bf3-35da-4b7e-ab2b-5bc6ac073dfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:29.581444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db0bf3-35da-4b7e-ab2b-5bc6ac073dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:29.583560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-74db0bf3-35da-4b7e-ab2b-5bc6ac073dfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:29.592258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:29.596172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:29.597142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 114/228] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:29.604414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db0bf3-35da-4b7e-ab2b-5bc6ac073dfb None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:29.727912 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5229d-0ac2-438e-b96b-a206ef16bd10 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:29.793797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21755278-d226-4b86-9b37-c5be768b4204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:29.794585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21755278-d226-4b86-9b37-c5be768b4204 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:29.794865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21755278-d226-4b86-9b37-c5be768b4204 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:29.795153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21755278-d226-4b86-9b37-c5be768b4204 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:29.801518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21755278-d226-4b86-9b37-c5be768b4204 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:29.802973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21755278-d226-4b86-9b37-c5be768b4204 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:29.804727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 115/229] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:29 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:29.810488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21755278-d226-4b86-9b37-c5be768b4204 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:29.856270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db0bf3-35da-4b7e-ab2b-5bc6ac073dfb None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:29.883720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:29.922750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb32bb5-9a9b-429e-b5f2-18ee4bf5451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:29.923444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32bb5-9a9b-429e-b5f2-18ee4bf5451b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:29.923727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32bb5-9a9b-429e-b5f2-18ee4bf5451b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:29.924000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb32bb5-9a9b-429e-b5f2-18ee4bf5451b None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:29.924796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb32bb5-9a9b-429e-b5f2-18ee4bf5451b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:29.925105 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb32bb5-9a9b-429e-b5f2-18ee4bf5451b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:29.926505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb32bb5-9a9b-429e-b5f2-18ee4bf5451b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:29.947214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 115/230] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:29.956490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb32bb5-9a9b-429e-b5f2-18ee4bf5451b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:29.959240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:30.003086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21755278-d226-4b86-9b37-c5be768b4204 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:30.073033 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384de8a-e1ec-4391-9206-e4685e2651dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:30.073903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384de8a-e1ec-4391-9206-e4685e2651dd None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:30.074187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384de8a-e1ec-4391-9206-e4685e2651dd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:30.074466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384de8a-e1ec-4391-9206-e4685e2651dd None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/users/6200a2a1841549a9ac633b1afc17dd1a/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:30.080703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384de8a-e1ec-4391-9206-e4685e2651dd None admin] RBAC: Authorizing `identity:create_grant(project_id=33b93c71e8a648a9bd47aac2f8dbacdf, user_id=6200a2a1841549a9ac633b1afc17dd1a, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:30.082174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384de8a-e1ec-4391-9206-e4685e2651dd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:30.091542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb32bb5-9a9b-429e-b5f2-18ee4bf5451b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:30.128524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a993a15-56fc-47ff-805f-75d9276a3c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:30.129651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a993a15-56fc-47ff-805f-75d9276a3c8d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:30.130084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a993a15-56fc-47ff-805f-75d9276a3c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:30.130502 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a993a15-56fc-47ff-805f-75d9276a3c8d None admin] PATH_INFO: `/v3/users/6200a2a1841549a9ac633b1afc17dd1a` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:30.131957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a993a15-56fc-47ff-805f-75d9276a3c8d None admin] RBAC: Authorizing `identity:get_user(user_id=6200a2a1841549a9ac633b1afc17dd1a)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:30.133604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a993a15-56fc-47ff-805f-75d9276a3c8d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:30.135422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 116/231] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:29 2022] GET /identity/v3/users/6200a2a1841549a9ac633b1afc17dd1a => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:30.145142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a993a15-56fc-47ff-805f-75d9276a3c8d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:30.177769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 116/232] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:32:29 2022] PUT /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/users/6200a2a1841549a9ac633b1afc17dd1a/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:30.204775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:30.284321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a993a15-56fc-47ff-805f-75d9276a3c8d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:30.358590 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffad1e-3a56-4900-901d-eb3a6f8e1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:30.359475 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffad1e-3a56-4900-901d-eb3a6f8e1944 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:30.359761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffad1e-3a56-4900-901d-eb3a6f8e1944 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:30.360038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffad1e-3a56-4900-901d-eb3a6f8e1944 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:30.362879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffad1e-3a56-4900-901d-eb3a6f8e1944 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:30.364409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffad1e-3a56-4900-901d-eb3a6f8e1944 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:30.366206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 117/233] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:30 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:30.372583 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384de8a-e1ec-4391-9206-e4685e2651dd None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:30.495374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384de8a-e1ec-4391-9206-e4685e2651dd None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:30.528289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311a4d-9040-4ce6-b548-78d0320a5afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:30.529480 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311a4d-9040-4ce6-b548-78d0320a5afa None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:30.529887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311a4d-9040-4ce6-b548-78d0320a5afa None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:30.530284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311a4d-9040-4ce6-b548-78d0320a5afa None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/users/6200a2a1841549a9ac633b1afc17dd1a/roles/3ef6518e7cfb491dab86c245c0aeac21` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:30.533369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3311a4d-9040-4ce6-b548-78d0320a5afa None admin] RBAC: Authorizing `identity:create_grant(project_id=33b93c71e8a648a9bd47aac2f8dbacdf, user_id=6200a2a1841549a9ac633b1afc17dd1a, role_id=3ef6518e7cfb491dab86c245c0aeac21)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:30.534962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3311a4d-9040-4ce6-b548-78d0320a5afa None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:30.632204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f3fc0-c4a0-4a91-b3c1-55daf0cb36bd None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:30.634792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f3fc0-c4a0-4a91-b3c1-55daf0cb36bd None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:30.634792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f3fc0-c4a0-4a91-b3c1-55daf0cb36bd None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:30.634792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 118/234] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:30.640981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c9713-3273-4235-be24-c4942f7990cb None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:30.641663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c9713-3273-4235-be24-c4942f7990cb None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:30.642085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c9713-3273-4235-be24-c4942f7990cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:30.644941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 117/235] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:32:30 2022] PUT /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/users/6200a2a1841549a9ac633b1afc17dd1a/roles/3ef6518e7cfb491dab86c245c0aeac21 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:32:30.677414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-fd2c9713-3273-4235-be24-c4942f7990cb None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:30.678703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-fd2c9713-3273-4235-be24-c4942f7990cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:30.826476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 119/236] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:30.864930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311a4d-9040-4ce6-b548-78d0320a5afa None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:30.869653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:30.884841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d265b4-d288-4fa9-8e29-040a6a744036 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:30.885057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d265b4-d288-4fa9-8e29-040a6a744036 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:30.885330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d265b4-d288-4fa9-8e29-040a6a744036 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:30.886881 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 120/237] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:32:30.893872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952d651-39ad-47f7-9e79-e2a71c94949d None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:30.894152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952d651-39ad-47f7-9e79-e2a71c94949d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:30.894430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952d651-39ad-47f7-9e79-e2a71c94949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:30.923426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-6952d651-39ad-47f7-9e79-e2a71c94949d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:30.925029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-6952d651-39ad-47f7-9e79-e2a71c94949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:30.977039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:31.015818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311a4d-9040-4ce6-b548-78d0320a5afa None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:31.029975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 121/238] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:31.058201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952d651-39ad-47f7-9e79-e2a71c94949d None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:31.117923 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fe54e-a1e2-4943-adf6-f914e6e500d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:31.119128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fe54e-a1e2-4943-adf6-f914e6e500d8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:31.119633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fe54e-a1e2-4943-adf6-f914e6e500d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:31.120379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fe54e-a1e2-4943-adf6-f914e6e500d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:31.142150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fe54e-a1e2-4943-adf6-f914e6e500d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-b66fe54e-a1e2-4943-adf6-f914e6e500d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:31.152932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:31.153838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:31.154604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:31.157785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 118/239] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:31.164767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fe54e-a1e2-4943-adf6-f914e6e500d8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:31.238164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952d651-39ad-47f7-9e79-e2a71c94949d None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:31.280281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:31.306605 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12192f-315e-4c7a-b149-fd84d61a9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:31.307931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12192f-315e-4c7a-b149-fd84d61a9649 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:31.308431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12192f-315e-4c7a-b149-fd84d61a9649 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:31.309671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12192f-315e-4c7a-b149-fd84d61a9649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:31.311024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12192f-315e-4c7a-b149-fd84d61a9649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:31.313349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12192f-315e-4c7a-b149-fd84d61a9649 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:31.315539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 122/240] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:31.320726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12192f-315e-4c7a-b149-fd84d61a9649 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:31.353292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fe54e-a1e2-4943-adf6-f914e6e500d8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:31.377967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:31.430062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45745a6a-38fb-4990-bd87-abece18bc626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:31.432431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45745a6a-38fb-4990-bd87-abece18bc626 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:31.433776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45745a6a-38fb-4990-bd87-abece18bc626 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:31.434285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45745a6a-38fb-4990-bd87-abece18bc626 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:31.436216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45745a6a-38fb-4990-bd87-abece18bc626 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:31.437439 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45745a6a-38fb-4990-bd87-abece18bc626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:31.440809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45745a6a-38fb-4990-bd87-abece18bc626 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:31.466718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 119/241] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:31.475325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45745a6a-38fb-4990-bd87-abece18bc626 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:31.487580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12192f-315e-4c7a-b149-fd84d61a9649 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:31.565640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068b7c6-2458-4da8-b18c-b72b92133e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:31.567209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068b7c6-2458-4da8-b18c-b72b92133e7f None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:31.567518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068b7c6-2458-4da8-b18c-b72b92133e7f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:31.567798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068b7c6-2458-4da8-b18c-b72b92133e7f None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:31.568514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068b7c6-2458-4da8-b18c-b72b92133e7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:31.569957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068b7c6-2458-4da8-b18c-b72b92133e7f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:31.636616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45745a6a-38fb-4990-bd87-abece18bc626 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:31.666732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:31.675922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4170528-c82e-4b90-877d-1d4919c32323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:31.676933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170528-c82e-4b90-877d-1d4919c32323 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:31.677223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170528-c82e-4b90-877d-1d4919c32323 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:31.677508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170528-c82e-4b90-877d-1d4919c32323 None admin] PATH_INFO: `/v3/users/4c9b2d50279b49f9b4e0535b552d6aa0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:31.690305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 123/242] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:32:31 2022] POST /identity/v3/users => generated 293 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:32:31.692963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4170528-c82e-4b90-877d-1d4919c32323 None admin] RBAC: Authorizing `identity:get_user(user_id=4c9b2d50279b49f9b4e0535b552d6aa0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:31.694492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4170528-c82e-4b90-877d-1d4919c32323 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:31.696335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 120/243] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:31 2022] GET /identity/v3/users/4c9b2d50279b49f9b4e0535b552d6aa0 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:31.703417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068b7c6-2458-4da8-b18c-b72b92133e7f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:31.839193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:31.846541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068b7c6-2458-4da8-b18c-b72b92133e7f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:31.901272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69613d-0650-4c7f-9ac8-bb3cac89ad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:31.901955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69613d-0650-4c7f-9ac8-bb3cac89ad79 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:31.902238 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69613d-0650-4c7f-9ac8-bb3cac89ad79 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:31.902513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69613d-0650-4c7f-9ac8-bb3cac89ad79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:31.946584 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a32bc-4ccc-469e-a435-5e65c473450e None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:31.947186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a32bc-4ccc-469e-a435-5e65c473450e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:31.947724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a32bc-4ccc-469e-a435-5e65c473450e None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:31.949378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 121/244] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:31.955778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796efb73-fc1a-4fed-a14c-2e035dd3780b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:31.956362 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796efb73-fc1a-4fed-a14c-2e035dd3780b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:31.956836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796efb73-fc1a-4fed-a14c-2e035dd3780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:31.977651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-796efb73-fc1a-4fed-a14c-2e035dd3780b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:31.979169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-796efb73-fc1a-4fed-a14c-2e035dd3780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:31.992358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69613d-0650-4c7f-9ac8-bb3cac89ad79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:31.993986 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69613d-0650-4c7f-9ac8-bb3cac89ad79 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:32.056546 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 122/245] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:32.083218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796efb73-fc1a-4fed-a14c-2e035dd3780b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:32.098435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:32.106070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 124/246] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:32.113693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69613d-0650-4c7f-9ac8-bb3cac89ad79 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:32.200119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796efb73-fc1a-4fed-a14c-2e035dd3780b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:32.218643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:32.228157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69613d-0650-4c7f-9ac8-bb3cac89ad79 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:32.240474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344cc3-a5fc-412c-a45a-334681ef39df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:32.246304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344cc3-a5fc-412c-a45a-334681ef39df None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:32.246304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344cc3-a5fc-412c-a45a-334681ef39df None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:32.246304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344cc3-a5fc-412c-a45a-334681ef39df None admin] PATH_INFO: `/v3/roles/member` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:32.253517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e344cc3-a5fc-412c-a45a-334681ef39df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-9e344cc3-a5fc-412c-a45a-334681ef39df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:32.262745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:32.263933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:32.264716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:32.265706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5060999-e433-4109-b636-cbffa6c32095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:32.266671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060999-e433-4109-b636-cbffa6c32095 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:32.266954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060999-e433-4109-b636-cbffa6c32095 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:32.267232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060999-e433-4109-b636-cbffa6c32095 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:32.267677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 123/247] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:32.271433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5060999-e433-4109-b636-cbffa6c32095 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:32.271433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5060999-e433-4109-b636-cbffa6c32095 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:32.273207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 125/248] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:32 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:32.274243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344cc3-a5fc-412c-a45a-334681ef39df None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:32.290604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5060999-e433-4109-b636-cbffa6c32095 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:32.367394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:32.392645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344cc3-a5fc-412c-a45a-334681ef39df None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:32.409420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5060999-e433-4109-b636-cbffa6c32095 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:32.432984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad9b5e-8904-4023-aa93-aa8ff5eee513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:32.433812 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad9b5e-8904-4023-aa93-aa8ff5eee513 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:32.434195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad9b5e-8904-4023-aa93-aa8ff5eee513 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:32.434575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad9b5e-8904-4023-aa93-aa8ff5eee513 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:32.435476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad9b5e-8904-4023-aa93-aa8ff5eee513 None admin] RBAC: Adding query filter params (name=member) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:32.435868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad9b5e-8904-4023-aa93-aa8ff5eee513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:32.437455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad9b5e-8904-4023-aa93-aa8ff5eee513 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:32.454157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af955-b47c-4454-bacc-ae50ed2c2bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:32.454455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af955-b47c-4454-bacc-ae50ed2c2bb2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:32.454739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af955-b47c-4454-bacc-ae50ed2c2bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:32.455015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af955-b47c-4454-bacc-ae50ed2c2bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:32.456359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af955-b47c-4454-bacc-ae50ed2c2bb2 None admin] RBAC: Adding query filter params (role.id=9ee3b802458741a6be937b8b8dcdc3f6, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf, user.id=4c9b2d50279b49f9b4e0535b552d6aa0) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:32.456462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af955-b47c-4454-bacc-ae50ed2c2bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:32.457913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af955-b47c-4454-bacc-ae50ed2c2bb2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:32.461025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 124/249] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:32.464369 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 126/250] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:32 2022] GET /identity/v3/role_assignments?user.id=4c9b2d50279b49f9b4e0535b552d6aa0&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=9ee3b802458741a6be937b8b8dcdc3f6 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:32.469008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad9b5e-8904-4023-aa93-aa8ff5eee513 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:32.525053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:32.606242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad9b5e-8904-4023-aa93-aa8ff5eee513 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:32.655185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a0e15-742d-434f-9177-ce066ff83560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:32.656137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a0e15-742d-434f-9177-ce066ff83560 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:32.656415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a0e15-742d-434f-9177-ce066ff83560 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:32.656687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a0e15-742d-434f-9177-ce066ff83560 None admin] PATH_INFO: `/v3/users/463b7bf567d14d1894ad2f1807a34cdd` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:32.657913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a0e15-742d-434f-9177-ce066ff83560 None admin] RBAC: Authorizing `identity:get_user(user_id=463b7bf567d14d1894ad2f1807a34cdd)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:32.659507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a0e15-742d-434f-9177-ce066ff83560 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:32.661141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 125/251] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:32 2022] GET /identity/v3/users/463b7bf567d14d1894ad2f1807a34cdd => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:32.666585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af955-b47c-4454-bacc-ae50ed2c2bb2 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:32.808608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af955-b47c-4454-bacc-ae50ed2c2bb2 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:32.846961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:32.855382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca179503-27ae-42cc-9d5a-106dbbf01e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:32.856257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179503-27ae-42cc-9d5a-106dbbf01e54 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:32.856540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179503-27ae-42cc-9d5a-106dbbf01e54 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:32.856818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179503-27ae-42cc-9d5a-106dbbf01e54 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:32.864145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca179503-27ae-42cc-9d5a-106dbbf01e54 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:32.865636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca179503-27ae-42cc-9d5a-106dbbf01e54 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:32.867635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 127/252] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:32 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:32.872937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a0e15-742d-434f-9177-ce066ff83560 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:33.015754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a0e15-742d-434f-9177-ce066ff83560 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:33.020376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:33.065259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cc544-5642-4c71-9e13-97335de28996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:33.066105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc544-5642-4c71-9e13-97335de28996 None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:33.066391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc544-5642-4c71-9e13-97335de28996 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:33.066677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cc544-5642-4c71-9e13-97335de28996 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/users/463b7bf567d14d1894ad2f1807a34cdd/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:33.068839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cc544-5642-4c71-9e13-97335de28996 None admin] RBAC: Authorizing `identity:create_grant(project_id=33b93c71e8a648a9bd47aac2f8dbacdf, user_id=463b7bf567d14d1894ad2f1807a34cdd, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:33.070338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cc544-5642-4c71-9e13-97335de28996 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:33.143970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb641c5-2273-4612-b923-f753a62ee1b2 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:33.144356 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb641c5-2273-4612-b923-f753a62ee1b2 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:33.144697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb641c5-2273-4612-b923-f753a62ee1b2 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:33.146386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 128/253] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:33.160783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73bf44-bf56-48ee-8471-eb3cd58ac49f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:33.161065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73bf44-bf56-48ee-8471-eb3cd58ac49f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:33.161351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73bf44-bf56-48ee-8471-eb3cd58ac49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:33.178038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 126/254] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:32:32 2022] PUT /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/users/463b7bf567d14d1894ad2f1807a34cdd/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:33.188934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2c73bf44-bf56-48ee-8471-eb3cd58ac49f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:33.190240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2c73bf44-bf56-48ee-8471-eb3cd58ac49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:33.259749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2150-2bbb-4212-8c64-6299d8e78b50 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:33.260403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2150-2bbb-4212-8c64-6299d8e78b50 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:33.260887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2150-2bbb-4212-8c64-6299d8e78b50 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:33.262744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 127/255] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:33.269106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf31c5-bf65-4e4b-a54b-dbde9bb37417 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:33.269723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf31c5-bf65-4e4b-a54b-dbde9bb37417 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:33.270231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf31c5-bf65-4e4b-a54b-dbde9bb37417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:33.289076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3bbf31c5-bf65-4e4b-a54b-dbde9bb37417 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:33.290635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3bbf31c5-bf65-4e4b-a54b-dbde9bb37417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:33.308466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 129/256] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:33.347908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73bf44-bf56-48ee-8471-eb3cd58ac49f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:33.368524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 128/257] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:33.396251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf31c5-bf65-4e4b-a54b-dbde9bb37417 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:33.546399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73bf44-bf56-48ee-8471-eb3cd58ac49f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:33.562479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf31c5-bf65-4e4b-a54b-dbde9bb37417 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:33.566061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:33.606259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:33.622904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a40cf-a080-4a4e-a023-a85fca95e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:33.623758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a40cf-a080-4a4e-a023-a85fca95e086 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:33.624048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a40cf-a080-4a4e-a023-a85fca95e086 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:33.624891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a40cf-a080-4a4e-a023-a85fca95e086 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:33.636826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece27f99-183f-4da1-8014-206ecd70efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:33.637650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece27f99-183f-4da1-8014-206ecd70efca None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:33.637989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece27f99-183f-4da1-8014-206ecd70efca None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:33.638273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece27f99-183f-4da1-8014-206ecd70efca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:33.650234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a40cf-a080-4a4e-a023-a85fca95e086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-299a40cf-a080-4a4e-a023-a85fca95e086 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:33.659712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:33.660588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:33.661434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 130/258] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:33.667148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece27f99-183f-4da1-8014-206ecd70efca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:33.673160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a40cf-a080-4a4e-a023-a85fca95e086 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ece27f99-183f-4da1-8014-206ecd70efca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:33.678232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:33.679976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:33.681737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:33.689592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 129/259] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:33.706106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece27f99-183f-4da1-8014-206ecd70efca None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:33.863106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece27f99-183f-4da1-8014-206ecd70efca None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:33.872858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a40cf-a080-4a4e-a023-a85fca95e086 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:33.933617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a925-7155-4ba2-9fb2-4a9d919d7030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:33.934589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a925-7155-4ba2-9fb2-4a9d919d7030 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:33.935047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a925-7155-4ba2-9fb2-4a9d919d7030 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:33.935524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a925-7155-4ba2-9fb2-4a9d919d7030 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:33.936477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a925-7155-4ba2-9fb2-4a9d919d7030 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:33.937625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a925-7155-4ba2-9fb2-4a9d919d7030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:33.942226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a925-7155-4ba2-9fb2-4a9d919d7030 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:33.957517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3342a7-3cf2-4845-8037-9267539f43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:33.958506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3342a7-3cf2-4845-8037-9267539f43a1 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:33.958991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3342a7-3cf2-4845-8037-9267539f43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:33.959532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3342a7-3cf2-4845-8037-9267539f43a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:33.960460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3342a7-3cf2-4845-8037-9267539f43a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:33.960941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3342a7-3cf2-4845-8037-9267539f43a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:33.962514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3342a7-3cf2-4845-8037-9267539f43a1 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:33.967373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 130/260] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:33.972837 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a925-7155-4ba2-9fb2-4a9d919d7030 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:33.978551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 131/261] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:33.984745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3342a7-3cf2-4845-8037-9267539f43a1 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:34.014740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:34.089229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:34.219761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a925-7155-4ba2-9fb2-4a9d919d7030 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:34.226288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3342a7-3cf2-4845-8037-9267539f43a1 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:34.282364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1463d7-8852-4288-a6e5-f799f34ff967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:34.283253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1463d7-8852-4288-a6e5-f799f34ff967 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:34.283597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1463d7-8852-4288-a6e5-f799f34ff967 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:34.283879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1463d7-8852-4288-a6e5-f799f34ff967 None admin] PATH_INFO: `/v3/users/6200a2a1841549a9ac633b1afc17dd1a` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:34.285810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1463d7-8852-4288-a6e5-f799f34ff967 None admin] RBAC: Authorizing `identity:get_user(user_id=6200a2a1841549a9ac633b1afc17dd1a)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:34.287277 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1463d7-8852-4288-a6e5-f799f34ff967 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:34.291564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 132/262] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:33 2022] GET /identity/v3/users/6200a2a1841549a9ac633b1afc17dd1a => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:34.294518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a5cd-d8f5-40d1-937c-819bb800ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:34.296749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1463d7-8852-4288-a6e5-f799f34ff967 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:34.297204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a5cd-d8f5-40d1-937c-819bb800ebaf None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:34.297605 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a5cd-d8f5-40d1-937c-819bb800ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:34.297894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9a5cd-d8f5-40d1-937c-819bb800ebaf None admin] PATH_INFO: `/v3/users/6200a2a1841549a9ac633b1afc17dd1a` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:34.301282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9a5cd-d8f5-40d1-937c-819bb800ebaf None admin] RBAC: Authorizing `identity:get_user(user_id=6200a2a1841549a9ac633b1afc17dd1a)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:34.302769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9a5cd-d8f5-40d1-937c-819bb800ebaf None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:34.308383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 131/263] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:33 2022] GET /identity/v3/users/6200a2a1841549a9ac633b1afc17dd1a => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:34.319770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a5cd-d8f5-40d1-937c-819bb800ebaf None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:34.476061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:34.495557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9a5cd-d8f5-40d1-937c-819bb800ebaf None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:34.516379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1463d7-8852-4288-a6e5-f799f34ff967 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:34.541042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:34.541958 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc39e2-3a0a-4e9f-9e28-a818f8f155fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:34.542606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc39e2-3a0a-4e9f-9e28-a818f8f155fd None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:34.542891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc39e2-3a0a-4e9f-9e28-a818f8f155fd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:34.543242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc39e2-3a0a-4e9f-9e28-a818f8f155fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:34.561064 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a8cb-28e4-4752-a1a0-a58da0530bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:34.562043 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a8cb-28e4-4752-a1a0-a58da0530bf0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:34.562563 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a8cb-28e4-4752-a1a0-a58da0530bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:34.563044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a8cb-28e4-4752-a1a0-a58da0530bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:34.693279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc39e2-3a0a-4e9f-9e28-a818f8f155fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:34.695533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc39e2-3a0a-4e9f-9e28-a818f8f155fd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:34.700354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8a8cb-28e4-4752-a1a0-a58da0530bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:34.702327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8a8cb-28e4-4752-a1a0-a58da0530bf0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:34.852388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:34.883064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 132/264] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:32:34.890644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc39e2-3a0a-4e9f-9e28-a818f8f155fd None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:34.917987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 133/265] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:34.924241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a8cb-28e4-4752-a1a0-a58da0530bf0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:34.947213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:35.078731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a8cb-28e4-4752-a1a0-a58da0530bf0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:35.094899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc39e2-3a0a-4e9f-9e28-a818f8f155fd None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:35.118580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c5593-57d9-4596-a384-f2af3ce892be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:35.119396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c5593-57d9-4596-a384-f2af3ce892be None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:35.119687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c5593-57d9-4596-a384-f2af3ce892be None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:35.119961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c5593-57d9-4596-a384-f2af3ce892be None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:35.121137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c5593-57d9-4596-a384-f2af3ce892be None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:35.122588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c5593-57d9-4596-a384-f2af3ce892be None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:35.124652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 134/266] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:34 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:35.130886 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c5593-57d9-4596-a384-f2af3ce892be None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:35.164071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe3197-a73f-4338-bc9d-206af0db7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:35.165268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe3197-a73f-4338-bc9d-206af0db7639 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:35.165781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe3197-a73f-4338-bc9d-206af0db7639 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:35.166339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe3197-a73f-4338-bc9d-206af0db7639 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:35.167751 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe3197-a73f-4338-bc9d-206af0db7639 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:35.169623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe3197-a73f-4338-bc9d-206af0db7639 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:35.176921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 133/267] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:34 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:35.179592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe3197-a73f-4338-bc9d-206af0db7639 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:35.226888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:35.243655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c5593-57d9-4596-a384-f2af3ce892be None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:35.257715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:35.286356 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6838d2f-0eba-4cde-b4cf-6ed623c745f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:35.287500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6838d2f-0eba-4cde-b4cf-6ed623c745f6 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:35.287866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6838d2f-0eba-4cde-b4cf-6ed623c745f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:35.288055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6838d2f-0eba-4cde-b4cf-6ed623c745f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:35.288884 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6838d2f-0eba-4cde-b4cf-6ed623c745f6 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf, user.id=6200a2a1841549a9ac633b1afc17dd1a) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:35.289194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6838d2f-0eba-4cde-b4cf-6ed623c745f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:35.290639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6838d2f-0eba-4cde-b4cf-6ed623c745f6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:35.298794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 135/268] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:35 2022] GET /identity/v3/role_assignments?user.id=6200a2a1841549a9ac633b1afc17dd1a&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:35.322788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe3197-a73f-4338-bc9d-206af0db7639 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:35.364263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72882cc2-2fd1-48c0-a8a7-f6c6109e2897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:35.365249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72882cc2-2fd1-48c0-a8a7-f6c6109e2897 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:35.365697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72882cc2-2fd1-48c0-a8a7-f6c6109e2897 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:35.366131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72882cc2-2fd1-48c0-a8a7-f6c6109e2897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:35.367110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72882cc2-2fd1-48c0-a8a7-f6c6109e2897 None admin] RBAC: Adding query filter params (role.id=3ef6518e7cfb491dab86c245c0aeac21, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf, user.id=6200a2a1841549a9ac633b1afc17dd1a) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:35.367625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72882cc2-2fd1-48c0-a8a7-f6c6109e2897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:35.369298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72882cc2-2fd1-48c0-a8a7-f6c6109e2897 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:35.376805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 134/269] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:35 2022] GET /identity/v3/role_assignments?user.id=6200a2a1841549a9ac633b1afc17dd1a&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=3ef6518e7cfb491dab86c245c0aeac21 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:35.576167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54aab5-daae-4fa9-8762-28c0c92ecc81 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:35.576818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54aab5-daae-4fa9-8762-28c0c92ecc81 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:35.577318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54aab5-daae-4fa9-8762-28c0c92ecc81 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:35.579438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 136/270] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:35.598264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14e18-4ad3-4d76-923d-73fd8b3e2afb None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:35.598905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14e18-4ad3-4d76-923d-73fd8b3e2afb None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:35.599404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14e18-4ad3-4d76-923d-73fd8b3e2afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:35.622445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-43b14e18-4ad3-4d76-923d-73fd8b3e2afb None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:35.623997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-43b14e18-4ad3-4d76-923d-73fd8b3e2afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:35.685401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd26fd-f587-48e6-92b9-25b18e11d2f7 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:35.686020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd26fd-f587-48e6-92b9-25b18e11d2f7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:35.686492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd26fd-f587-48e6-92b9-25b18e11d2f7 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:35.688906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 137/271] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:32:35.694273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c4dd-1149-4c02-8446-d6ca472c3e11 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:35.694855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c4dd-1149-4c02-8446-d6ca472c3e11 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:35.695366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c4dd-1149-4c02-8446-d6ca472c3e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:35.721141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-bb63c4dd-1149-4c02-8446-d6ca472c3e11 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:35.722333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-bb63c4dd-1149-4c02-8446-d6ca472c3e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:35.730836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 135/272] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:35.755438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b14e18-4ad3-4d76-923d-73fd8b3e2afb None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:35.826286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 138/273] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:35.835383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:35.852533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c4dd-1149-4c02-8446-d6ca472c3e11 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:35.926536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b14e18-4ad3-4d76-923d-73fd8b3e2afb None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:35.982642 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842a7ef-c50a-46c3-8e3d-494436f49d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:35.983493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a7ef-c50a-46c3-8e3d-494436f49d0f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:35.984328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a7ef-c50a-46c3-8e3d-494436f49d0f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:35.984609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842a7ef-c50a-46c3-8e3d-494436f49d0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:35.989236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:35.996221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842a7ef-c50a-46c3-8e3d-494436f49d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-2842a7ef-c50a-46c3-8e3d-494436f49d0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:36.004520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:36.005460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:36.006250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 136/274] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:36.013879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842a7ef-c50a-46c3-8e3d-494436f49d0f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:36.031452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c4dd-1149-4c02-8446-d6ca472c3e11 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:36.072893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da0a31-ad45-45dc-aa8d-bf87d83a170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:36.073943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da0a31-ad45-45dc-aa8d-bf87d83a170a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.074376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da0a31-ad45-45dc-aa8d-bf87d83a170a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.074656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da0a31-ad45-45dc-aa8d-bf87d83a170a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.087953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da0a31-ad45-45dc-aa8d-bf87d83a170a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-c6da0a31-ad45-45dc-aa8d-bf87d83a170a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:36.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:36.098207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 139/275] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:36.100092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db27a1-00fd-44d4-a8d7-23456a6bcf13 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.100790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db27a1-00fd-44d4-a8d7-23456a6bcf13 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.100790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db27a1-00fd-44d4-a8d7-23456a6bcf13 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.101504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 140/276] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:36.104522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db27a1-00fd-44d4-a8d7-23456a6bcf13 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:36.137474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842a7ef-c50a-46c3-8e3d-494436f49d0f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:36.145802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:36.174196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e475f1f-3ba6-4f51-8cff-e8a46476bb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:36.174868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e475f1f-3ba6-4f51-8cff-e8a46476bb10 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.175149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e475f1f-3ba6-4f51-8cff-e8a46476bb10 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.175465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e475f1f-3ba6-4f51-8cff-e8a46476bb10 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.176208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e475f1f-3ba6-4f51-8cff-e8a46476bb10 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:36.176519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e475f1f-3ba6-4f51-8cff-e8a46476bb10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:36.178021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e475f1f-3ba6-4f51-8cff-e8a46476bb10 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:36.191824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 137/277] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:36.191824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de8ce8-c2c9-4120-a719-219415cf95de None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.191824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de8ce8-c2c9-4120-a719-219415cf95de None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.191824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de8ce8-c2c9-4120-a719-219415cf95de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.208519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-64de8ce8-c2c9-4120-a719-219415cf95de None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:36.209705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-64de8ce8-c2c9-4120-a719-219415cf95de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:36.220615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db27a1-00fd-44d4-a8d7-23456a6bcf13 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:36.261391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55e4a0-e9c6-4c3f-83b3-3c1bdcb3d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:36.262060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55e4a0-e9c6-4c3f-83b3-3c1bdcb3d367 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.262341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55e4a0-e9c6-4c3f-83b3-3c1bdcb3d367 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.262614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55e4a0-e9c6-4c3f-83b3-3c1bdcb3d367 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.263368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55e4a0-e9c6-4c3f-83b3-3c1bdcb3d367 None admin] RBAC: Adding query filter params (name=member) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:36.263693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55e4a0-e9c6-4c3f-83b3-3c1bdcb3d367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:36.265112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55e4a0-e9c6-4c3f-83b3-3c1bdcb3d367 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:36.270789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:36.274577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 141/278] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:36.275405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55e4a0-e9c6-4c3f-83b3-3c1bdcb3d367 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:36.291695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 138/279] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:36.292945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de8ce8-c2c9-4120-a719-219415cf95de None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:36.399014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:36.403044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de8ce8-c2c9-4120-a719-219415cf95de None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:36.406746 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55e4a0-e9c6-4c3f-83b3-3c1bdcb3d367 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:36.438916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42101d7-e08b-4450-a907-06359feaf2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:36.439836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42101d7-e08b-4450-a907-06359feaf2ad None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.440223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42101d7-e08b-4450-a907-06359feaf2ad None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.440540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42101d7-e08b-4450-a907-06359feaf2ad None admin] PATH_INFO: `/v3/users/1c38e79df815440d84af5a313e46a277` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.441415 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827f9ed-1c1c-4ff3-a723-540cfaa05cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:36.442444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827f9ed-1c1c-4ff3-a723-540cfaa05cbb None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.442732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827f9ed-1c1c-4ff3-a723-540cfaa05cbb None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.443006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827f9ed-1c1c-4ff3-a723-540cfaa05cbb None admin] PATH_INFO: `/v3/users/4c9b2d50279b49f9b4e0535b552d6aa0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.447205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827f9ed-1c1c-4ff3-a723-540cfaa05cbb None admin] RBAC: Authorizing `identity:get_user(user_id=4c9b2d50279b49f9b4e0535b552d6aa0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:36.449078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827f9ed-1c1c-4ff3-a723-540cfaa05cbb None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:36.456322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 142/280] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:36 2022] GET /identity/v3/users/4c9b2d50279b49f9b4e0535b552d6aa0 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:36.457317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827f9ed-1c1c-4ff3-a723-540cfaa05cbb None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:36.461523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42101d7-e08b-4450-a907-06359feaf2ad None admin] RBAC: Authorizing `identity:get_user(user_id=1c38e79df815440d84af5a313e46a277)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:36.463142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42101d7-e08b-4450-a907-06359feaf2ad None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:36.470869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 139/281] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:36 2022] GET /identity/v3/users/1c38e79df815440d84af5a313e46a277 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:36.470869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42101d7-e08b-4450-a907-06359feaf2ad None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:36.534147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:36.567423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827f9ed-1c1c-4ff3-a723-540cfaa05cbb None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:36.575210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42101d7-e08b-4450-a907-06359feaf2ad None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:36.601635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff00bb-2648-428f-826b-4d91b4d20bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:36.602415 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff00bb-2648-428f-826b-4d91b4d20bfc None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.602692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff00bb-2648-428f-826b-4d91b4d20bfc None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.602962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff00bb-2648-428f-826b-4d91b4d20bfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.604135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff00bb-2648-428f-826b-4d91b4d20bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:36.605563 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff00bb-2648-428f-826b-4d91b4d20bfc None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:36.607167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 143/282] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:32:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:36.607945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff00bb-2648-428f-826b-4d91b4d20bfc None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:36.613182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c83145-d491-44a9-baf9-c90c72182d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:36.614051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c83145-d491-44a9-baf9-c90c72182d1a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.614334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c83145-d491-44a9-baf9-c90c72182d1a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.614628 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c83145-d491-44a9-baf9-c90c72182d1a None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.615844 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c83145-d491-44a9-baf9-c90c72182d1a None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:36.617292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c83145-d491-44a9-baf9-c90c72182d1a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:36.618977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 140/283] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:36 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:36.620169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69215721-8d9a-485f-aa79-17df433fbcb3 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.620452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69215721-8d9a-485f-aa79-17df433fbcb3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.620728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69215721-8d9a-485f-aa79-17df433fbcb3 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.621937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 141/284] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:36.622610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69215721-8d9a-485f-aa79-17df433fbcb3 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:36.648326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:36.719298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff00bb-2648-428f-826b-4d91b4d20bfc None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:36.733408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69215721-8d9a-485f-aa79-17df433fbcb3 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:36.756139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5e632-9cca-4eab-a2fa-114418cbfd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:36.756800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5e632-9cca-4eab-a2fa-114418cbfd2b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.757078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5e632-9cca-4eab-a2fa-114418cbfd2b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.757351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5e632-9cca-4eab-a2fa-114418cbfd2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.758171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5e632-9cca-4eab-a2fa-114418cbfd2b None admin] RBAC: Adding query filter params (role.id=0b03acccb970430e8e3b5a7921cb70d0, user.id=1c38e79df815440d84af5a313e46a277, scope.system=all) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:36.758482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5e632-9cca-4eab-a2fa-114418cbfd2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:36.759980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5e632-9cca-4eab-a2fa-114418cbfd2b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:36.762367 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:36.766326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 144/285] 10.222.0.78 () {56 vars in 1308 bytes} [Fri Jun 17 08:32:36 2022] GET /identity/v3/role_assignments?user.id=1c38e79df815440d84af5a313e46a277&scope.system=all&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:36.766920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5e632-9cca-4eab-a2fa-114418cbfd2b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:36.780598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8aa0a-9023-4c03-a572-237152fbff8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:36.781447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8aa0a-9023-4c03-a572-237152fbff8f None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.781760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8aa0a-9023-4c03-a572-237152fbff8f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.782018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8aa0a-9023-4c03-a572-237152fbff8f None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.782773 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8aa0a-9023-4c03-a572-237152fbff8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:36.784315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8aa0a-9023-4c03-a572-237152fbff8f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:36.887394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 142/286] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:32:36 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:32:36.887394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37f513-a9e2-4765-8e8c-0a331d53af5d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.887394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37f513-a9e2-4765-8e8c-0a331d53af5d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.887394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37f513-a9e2-4765-8e8c-0a331d53af5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.897614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5e632-9cca-4eab-a2fa-114418cbfd2b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:36.901622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3b37f513-a9e2-4765-8e8c-0a331d53af5d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:36.904864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3b37f513-a9e2-4765-8e8c-0a331d53af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:36.950229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c7906-894a-4826-bd9c-0fba664285dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:36.951453 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c7906-894a-4826-bd9c-0fba664285dc None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:36.951711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c7906-894a-4826-bd9c-0fba664285dc None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:36.951984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c7906-894a-4826-bd9c-0fba664285dc None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/users/4c9b2d50279b49f9b4e0535b552d6aa0/roles/9ee3b802458741a6be937b8b8dcdc3f6` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:36.956880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c7906-894a-4826-bd9c-0fba664285dc None admin] RBAC: Authorizing `identity:create_grant(project_id=33b93c71e8a648a9bd47aac2f8dbacdf, user_id=4c9b2d50279b49f9b4e0535b552d6aa0, role_id=9ee3b802458741a6be937b8b8dcdc3f6)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:36.958871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c7906-894a-4826-bd9c-0fba664285dc None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:36.997590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 143/287] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:37.021631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37f513-a9e2-4765-8e8c-0a331d53af5d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:37.026728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 145/288] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:32:36 2022] PUT /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/users/4c9b2d50279b49f9b4e0535b552d6aa0/roles/9ee3b802458741a6be937b8b8dcdc3f6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:37.036932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:37.145998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37f513-a9e2-4765-8e8c-0a331d53af5d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:37.186669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a501d5-547b-4636-a6b3-e00b2015cc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:37.188079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a501d5-547b-4636-a6b3-e00b2015cc26 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:37.188362 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a501d5-547b-4636-a6b3-e00b2015cc26 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:37.188639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a501d5-547b-4636-a6b3-e00b2015cc26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:37.204141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a501d5-547b-4636-a6b3-e00b2015cc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-d9a501d5-547b-4636-a6b3-e00b2015cc26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:37.212297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:37.213190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:37.214023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:37.214998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 144/289] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:37.220228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c7906-894a-4826-bd9c-0fba664285dc None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:37.290883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:37.338916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c7906-894a-4826-bd9c-0fba664285dc None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:37.378528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066439db-e5b8-4f97-aabf-9b1fa5de0f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:37.379212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066439db-e5b8-4f97-aabf-9b1fa5de0f80 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:37.379530 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066439db-e5b8-4f97-aabf-9b1fa5de0f80 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:37.379812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066439db-e5b8-4f97-aabf-9b1fa5de0f80 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:37.380571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066439db-e5b8-4f97-aabf-9b1fa5de0f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:37.380879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066439db-e5b8-4f97-aabf-9b1fa5de0f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:37.382282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066439db-e5b8-4f97-aabf-9b1fa5de0f80 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:37.392980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 146/290] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:37.398966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a501d5-547b-4636-a6b3-e00b2015cc26 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:37.500466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:37.545211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a501d5-547b-4636-a6b3-e00b2015cc26 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:37.594822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2ea9f-5a4d-4c4e-bbce-4915c9bd27fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:37.595748 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2ea9f-5a4d-4c4e-bbce-4915c9bd27fc None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:37.596037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2ea9f-5a4d-4c4e-bbce-4915c9bd27fc None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:37.596316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2ea9f-5a4d-4c4e-bbce-4915c9bd27fc None admin] PATH_INFO: `/v3/users/463b7bf567d14d1894ad2f1807a34cdd` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:37.597548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2ea9f-5a4d-4c4e-bbce-4915c9bd27fc None admin] RBAC: Authorizing `identity:get_user(user_id=463b7bf567d14d1894ad2f1807a34cdd)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:37.599028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2ea9f-5a4d-4c4e-bbce-4915c9bd27fc None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:37.601042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 145/291] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:37 2022] GET /identity/v3/users/463b7bf567d14d1894ad2f1807a34cdd => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:37.608473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066439db-e5b8-4f97-aabf-9b1fa5de0f80 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:37.755121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066439db-e5b8-4f97-aabf-9b1fa5de0f80 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:37.785526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:37.799494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec8284-19fc-40fd-b97c-26de3bcf8a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:37.800078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec8284-19fc-40fd-b97c-26de3bcf8a2f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:37.800360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec8284-19fc-40fd-b97c-26de3bcf8a2f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:37.800633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec8284-19fc-40fd-b97c-26de3bcf8a2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:37.894773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec8284-19fc-40fd-b97c-26de3bcf8a2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:37.896253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec8284-19fc-40fd-b97c-26de3bcf8a2f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:38.028642 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 147/292] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:38.034971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2ea9f-5a4d-4c4e-bbce-4915c9bd27fc None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:38.174351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2ea9f-5a4d-4c4e-bbce-4915c9bd27fc None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:38.221395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e23802-5135-431c-a02b-ce39725acff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:38.222263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23802-5135-431c-a02b-ce39725acff1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:38.222545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23802-5135-431c-a02b-ce39725acff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:38.222823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23802-5135-431c-a02b-ce39725acff1 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:38.224159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e23802-5135-431c-a02b-ce39725acff1 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:38.225601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e23802-5135-431c-a02b-ce39725acff1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:38.227557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 146/293] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:38 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:38.233513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec8284-19fc-40fd-b97c-26de3bcf8a2f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:38.259718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:38.361451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec8284-19fc-40fd-b97c-26de3bcf8a2f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:38.405465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb56dc4-9fd4-4ac2-bae2-96a36f6d2085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:38.406225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb56dc4-9fd4-4ac2-bae2-96a36f6d2085 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:38.406509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb56dc4-9fd4-4ac2-bae2-96a36f6d2085 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:38.406791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb56dc4-9fd4-4ac2-bae2-96a36f6d2085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:38.407648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb56dc4-9fd4-4ac2-bae2-96a36f6d2085 None admin] RBAC: Adding query filter params (role.id=0b03acccb970430e8e3b5a7921cb70d0, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf, user.id=463b7bf567d14d1894ad2f1807a34cdd) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:38.407966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb56dc4-9fd4-4ac2-bae2-96a36f6d2085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:38.409556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb56dc4-9fd4-4ac2-bae2-96a36f6d2085 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:38.423507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 148/294] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:38 2022] GET /identity/v3/role_assignments?user.id=463b7bf567d14d1894ad2f1807a34cdd&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:39.431871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16a81b-1f06-45f3-b953-5d85c6bd06f9 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.432417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16a81b-1f06-45f3-b953-5d85c6bd06f9 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.432417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16a81b-1f06-45f3-b953-5d85c6bd06f9 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:39.433936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 147/295] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:39.440124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde715c-9ea7-4e1a-89c1-06ef97f64338 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.445853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde715c-9ea7-4e1a-89c1-06ef97f64338 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.445853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde715c-9ea7-4e1a-89c1-06ef97f64338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:39.513369 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-adde715c-9ea7-4e1a-89c1-06ef97f64338 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:39.514893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-adde715c-9ea7-4e1a-89c1-06ef97f64338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:39.559517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488148bd-efbb-4e83-b758-8ff9f672d738 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.560224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488148bd-efbb-4e83-b758-8ff9f672d738 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.560707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488148bd-efbb-4e83-b758-8ff9f672d738 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:39.564224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 148/296] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:39.569823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c9730-ee9d-4148-955d-0d810dffd195 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.570477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c9730-ee9d-4148-955d-0d810dffd195 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.570961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c9730-ee9d-4148-955d-0d810dffd195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:39.589800 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:39.591718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-dc4c9730-ee9d-4148-955d-0d810dffd195 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:39.594004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-dc4c9730-ee9d-4148-955d-0d810dffd195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:39.598042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 149/297] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:39.623840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde715c-9ea7-4e1a-89c1-06ef97f64338 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:39.642235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:39.664757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 149/298] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:39.666267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916078e-71e0-4762-a649-eaedc716fb5f None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.666561 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916078e-71e0-4762-a649-eaedc716fb5f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.666840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916078e-71e0-4762-a649-eaedc716fb5f None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:39.668328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 150/299] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:39.671126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6101-fb30-4b62-8e23-ab4576b1b2a2 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.672115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6101-fb30-4b62-8e23-ab4576b1b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.672587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6101-fb30-4b62-8e23-ab4576b1b2a2 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:39.674230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 151/300] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:39.675655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4550b-fab1-45db-b96d-180259552d9a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.676012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4550b-fab1-45db-b96d-180259552d9a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.676380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4550b-fab1-45db-b96d-180259552d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:39.695710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-19c4550b-fab1-45db-b96d-180259552d9a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:39.696814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-19c4550b-fab1-45db-b96d-180259552d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:39.730227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde715c-9ea7-4e1a-89c1-06ef97f64338 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:39.763095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 152/301] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:39.764590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6233c2-5e5c-4dfd-b87c-a37503abbb14 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.764945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6233c2-5e5c-4dfd-b87c-a37503abbb14 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.765224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6233c2-5e5c-4dfd-b87c-a37503abbb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:39.768080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559dc46-4383-431c-aa5d-b54a6b9e0fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:39.768971 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559dc46-4383-431c-aa5d-b54a6b9e0fd0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.769415 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559dc46-4383-431c-aa5d-b54a6b9e0fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.769668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559dc46-4383-431c-aa5d-b54a6b9e0fd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:39.780292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559dc46-4383-431c-aa5d-b54a6b9e0fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:39.783538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-6e6233c2-5e5c-4dfd-b87c-a37503abbb14 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:39.784714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6e6233c2-5e5c-4dfd-b87c-a37503abbb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-a559dc46-4383-431c-aa5d-b54a6b9e0fd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:39.788696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:39.789546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:39.790325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 150/302] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:39.790961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559dc46-4383-431c-aa5d-b54a6b9e0fd0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:39.848665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:39.855797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 153/303] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:39.856594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6233c2-5e5c-4dfd-b87c-a37503abbb14 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:39.877508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:39.900584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559dc46-4383-431c-aa5d-b54a6b9e0fd0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:39.934617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a47e1-2dd2-447e-9658-edf8d7a2c05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:39.935427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a47e1-2dd2-447e-9658-edf8d7a2c05c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.935712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a47e1-2dd2-447e-9658-edf8d7a2c05c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.935987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a47e1-2dd2-447e-9658-edf8d7a2c05c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:39.946593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a47e1-2dd2-447e-9658-edf8d7a2c05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:39.955013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6233c2-5e5c-4dfd-b87c-a37503abbb14 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-fc9a47e1-2dd2-447e-9658-edf8d7a2c05c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:39.955149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:39.956150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 151/304] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:39.957103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a47e1-2dd2-447e-9658-edf8d7a2c05c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:39.989774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4424170-e01d-4949-b479-a8f29f443125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:39.990560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4424170-e01d-4949-b479-a8f29f443125 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:39.990846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4424170-e01d-4949-b479-a8f29f443125 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:39.991127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4424170-e01d-4949-b479-a8f29f443125 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.009076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4424170-e01d-4949-b479-a8f29f443125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-b4424170-e01d-4949-b479-a8f29f443125 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:40.017752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:40.018820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 154/305] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:40.020176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4424170-e01d-4949-b479-a8f29f443125 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:40.065399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a47e1-2dd2-447e-9658-edf8d7a2c05c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.076277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:40.099483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a819f4-8d52-4731-9be8-348926d9e3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:40.100151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a819f4-8d52-4731-9be8-348926d9e3b1 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:40.100435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a819f4-8d52-4731-9be8-348926d9e3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:40.100706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a819f4-8d52-4731-9be8-348926d9e3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.101441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a819f4-8d52-4731-9be8-348926d9e3b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:40.101748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a819f4-8d52-4731-9be8-348926d9e3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:40.103126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a819f4-8d52-4731-9be8-348926d9e3b1 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:40.105614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:40.112823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 152/306] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:40.113612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a819f4-8d52-4731-9be8-348926d9e3b1 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:40.125460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4424170-e01d-4949-b479-a8f29f443125 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.171783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe519e80-6511-450b-a1a9-a9c2a695f856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:40.172575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe519e80-6511-450b-a1a9-a9c2a695f856 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:40.172865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe519e80-6511-450b-a1a9-a9c2a695f856 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:40.173143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe519e80-6511-450b-a1a9-a9c2a695f856 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.174316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe519e80-6511-450b-a1a9-a9c2a695f856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:40.175808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe519e80-6511-450b-a1a9-a9c2a695f856 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:40.177429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 155/307] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:40.178176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe519e80-6511-450b-a1a9-a9c2a695f856 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:40.214726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a819f4-8d52-4731-9be8-348926d9e3b1 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.247722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eca9a-ff74-40e9-a17c-a2513497f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:40.248387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eca9a-ff74-40e9-a17c-a2513497f5ed None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:40.248676 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eca9a-ff74-40e9-a17c-a2513497f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:40.248954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eca9a-ff74-40e9-a17c-a2513497f5ed None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.249728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744eca9a-ff74-40e9-a17c-a2513497f5ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:40.250032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744eca9a-ff74-40e9-a17c-a2513497f5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:40.251451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744eca9a-ff74-40e9-a17c-a2513497f5ed None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:40.259440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 153/308] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:40.261106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eca9a-ff74-40e9-a17c-a2513497f5ed None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:40.289736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe519e80-6511-450b-a1a9-a9c2a695f856 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.312982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:40.321500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:40.323112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fb5a7-a63e-4db1-8ff1-b771a92e242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:40.323801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fb5a7-a63e-4db1-8ff1-b771a92e242f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:40.324084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fb5a7-a63e-4db1-8ff1-b771a92e242f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:40.324363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fb5a7-a63e-4db1-8ff1-b771a92e242f None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.325101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fb5a7-a63e-4db1-8ff1-b771a92e242f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:40.327920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fb5a7-a63e-4db1-8ff1-b771a92e242f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:40.327920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fb5a7-a63e-4db1-8ff1-b771a92e242f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:40.336214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 156/309] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:40.336997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fb5a7-a63e-4db1-8ff1-b771a92e242f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:40.363042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eca9a-ff74-40e9-a17c-a2513497f5ed None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.398051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cd9a2-cd70-416a-81fd-10ae10553792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:40.398926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cd9a2-cd70-416a-81fd-10ae10553792 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:40.399208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cd9a2-cd70-416a-81fd-10ae10553792 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:40.399534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cd9a2-cd70-416a-81fd-10ae10553792 None admin] PATH_INFO: `/v3/users/1c38e79df815440d84af5a313e46a277` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.400792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cd9a2-cd70-416a-81fd-10ae10553792 None admin] RBAC: Authorizing `identity:get_user(user_id=1c38e79df815440d84af5a313e46a277)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:40.402236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cd9a2-cd70-416a-81fd-10ae10553792 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:40.403902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 154/310] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:40 2022] GET /identity/v3/users/1c38e79df815440d84af5a313e46a277 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:40.404658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cd9a2-cd70-416a-81fd-10ae10553792 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:40.437462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fb5a7-a63e-4db1-8ff1-b771a92e242f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.472586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683413a-2783-419c-a6ca-bd23cfcc7b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:40.473183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683413a-2783-419c-a6ca-bd23cfcc7b00 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:40.473463 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683413a-2783-419c-a6ca-bd23cfcc7b00 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:40.473737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683413a-2783-419c-a6ca-bd23cfcc7b00 None admin] PATH_INFO: `/v3/groups` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.474421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683413a-2783-419c-a6ca-bd23cfcc7b00 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:40.475894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683413a-2783-419c-a6ca-bd23cfcc7b00 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:40.509993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cd9a2-cd70-416a-81fd-10ae10553792 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.535417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:40.542722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5bce9-4a6a-469b-aa0e-9487f0cf5a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:40.543602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5bce9-4a6a-469b-aa0e-9487f0cf5a5c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:40.543883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5bce9-4a6a-469b-aa0e-9487f0cf5a5c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:40.544209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5bce9-4a6a-469b-aa0e-9487f0cf5a5c None admin] PATH_INFO: `/v3/users/4c9b2d50279b49f9b4e0535b552d6aa0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.545380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5bce9-4a6a-469b-aa0e-9487f0cf5a5c None admin] RBAC: Authorizing `identity:get_user(user_id=4c9b2d50279b49f9b4e0535b552d6aa0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:40.546851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5bce9-4a6a-469b-aa0e-9487f0cf5a5c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:40.548666 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 155/311] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:40 2022] GET /identity/v3/users/4c9b2d50279b49f9b4e0535b552d6aa0 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:40.549235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5bce9-4a6a-469b-aa0e-9487f0cf5a5c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:40.551107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 157/312] 10.222.0.78 () {60 vars in 1134 bytes} [Fri Jun 17 08:32:40 2022] POST /identity/v3/groups => generated 229 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:32:40.564467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683413a-2783-419c-a6ca-bd23cfcc7b00 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:40.617047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:40.675078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5bce9-4a6a-469b-aa0e-9487f0cf5a5c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.677788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683413a-2783-419c-a6ca-bd23cfcc7b00 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.714171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677ef40-59ad-4259-9eef-eb3ec894ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:40.715044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677ef40-59ad-4259-9eef-eb3ec894ac04 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:40.715960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677ef40-59ad-4259-9eef-eb3ec894ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:40.715960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677ef40-59ad-4259-9eef-eb3ec894ac04 None admin] PATH_INFO: `/v3/users/b22b51aad54240a9ada8877bf1626d93` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.721921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45630022-3ca5-441f-ae78-215a918bb4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:40.722363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630022-3ca5-441f-ae78-215a918bb4d8 None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:40.722698 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630022-3ca5-441f-ae78-215a918bb4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:40.722928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630022-3ca5-441f-ae78-215a918bb4d8 None admin] PATH_INFO: `/v3/system/users/1c38e79df815440d84af5a313e46a277/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.724475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45630022-3ca5-441f-ae78-215a918bb4d8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1c38e79df815440d84af5a313e46a277, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:40.725868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45630022-3ca5-441f-ae78-215a918bb4d8 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:40.731919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677ef40-59ad-4259-9eef-eb3ec894ac04 None admin] RBAC: Authorizing `identity:get_user(user_id=b22b51aad54240a9ada8877bf1626d93)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:40.733934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677ef40-59ad-4259-9eef-eb3ec894ac04 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:40.735735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 156/313] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:40 2022] GET /identity/v3/users/b22b51aad54240a9ada8877bf1626d93 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:40.736501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677ef40-59ad-4259-9eef-eb3ec894ac04 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:40.793780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:40.822340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 158/314] 10.222.0.78 () {58 vars in 1334 bytes} [Fri Jun 17 08:32:40 2022] PUT /identity/v3/system/users/1c38e79df815440d84af5a313e46a277/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:40.823343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45630022-3ca5-441f-ae78-215a918bb4d8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:40.842938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677ef40-59ad-4259-9eef-eb3ec894ac04 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.885243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd5222-7bb4-4dac-85da-97ec8dc5e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:40.886361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5222-7bb4-4dac-85da-97ec8dc5e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:40.886361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5222-7bb4-4dac-85da-97ec8dc5e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:40.886709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5222-7bb4-4dac-85da-97ec8dc5e2d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:40.967335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45630022-3ca5-441f-ae78-215a918bb4d8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:40.970788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd5222-7bb4-4dac-85da-97ec8dc5e2d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:40.972421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd5222-7bb4-4dac-85da-97ec8dc5e2d2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:40.981109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:41.010321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72755a59-b73e-4ea2-9bb2-2cc86c1faaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:41.010981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72755a59-b73e-4ea2-9bb2-2cc86c1faaf9 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:41.011263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72755a59-b73e-4ea2-9bb2-2cc86c1faaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:41.011639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72755a59-b73e-4ea2-9bb2-2cc86c1faaf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:41.012710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72755a59-b73e-4ea2-9bb2-2cc86c1faaf9 None admin] RBAC: Adding query filter params (role.id=9ee3b802458741a6be937b8b8dcdc3f6, user.id=b22b51aad54240a9ada8877bf1626d93, scope.system=all) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:41.012814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72755a59-b73e-4ea2-9bb2-2cc86c1faaf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:41.014222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72755a59-b73e-4ea2-9bb2-2cc86c1faaf9 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:41.021670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 159/315] 10.222.0.78 () {56 vars in 1308 bytes} [Fri Jun 17 08:32:40 2022] GET /identity/v3/role_assignments?user.id=b22b51aad54240a9ada8877bf1626d93&scope.system=all&role.id=9ee3b802458741a6be937b8b8dcdc3f6 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:41.042073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:41.108941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 157/316] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:41.110577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72755a59-b73e-4ea2-9bb2-2cc86c1faaf9 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:41.219896 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72755a59-b73e-4ea2-9bb2-2cc86c1faaf9 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:41.254833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76811108-6ab7-4d90-b74b-25dc09572b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:41.255974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811108-6ab7-4d90-b74b-25dc09572b63 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:41.256418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811108-6ab7-4d90-b74b-25dc09572b63 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:41.256831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811108-6ab7-4d90-b74b-25dc09572b63 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:41.258173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76811108-6ab7-4d90-b74b-25dc09572b63 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:41.259778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76811108-6ab7-4d90-b74b-25dc09572b63 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:41.261932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 160/317] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:41 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:41.268465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd5222-7bb4-4dac-85da-97ec8dc5e2d2 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:41.376759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd5222-7bb4-4dac-85da-97ec8dc5e2d2 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:41.412944 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8636c92-f134-4369-a194-66e268bc5e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:41.413604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8636c92-f134-4369-a194-66e268bc5e81 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:41.413889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8636c92-f134-4369-a194-66e268bc5e81 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:41.414188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8636c92-f134-4369-a194-66e268bc5e81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:41.414996 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8636c92-f134-4369-a194-66e268bc5e81 None admin] RBAC: Adding query filter params (role.id=9ee3b802458741a6be937b8b8dcdc3f6, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf, user.id=4c9b2d50279b49f9b4e0535b552d6aa0) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:41.415311 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8636c92-f134-4369-a194-66e268bc5e81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:41.416778 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8636c92-f134-4369-a194-66e268bc5e81 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:41.423765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 158/318] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:32:41 2022] GET /identity/v3/role_assignments?user.id=4c9b2d50279b49f9b4e0535b552d6aa0&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=9ee3b802458741a6be937b8b8dcdc3f6 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:42.765764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166cfa8-3cca-4635-9d4b-574f8a0b3149 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:42.766483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166cfa8-3cca-4635-9d4b-574f8a0b3149 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:42.766483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166cfa8-3cca-4635-9d4b-574f8a0b3149 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:42.767798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 161/319] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:42.773216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb3d7-afad-4d35-9a60-43e8f26758a1 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:42.773602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb3d7-afad-4d35-9a60-43e8f26758a1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:42.773763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb3d7-afad-4d35-9a60-43e8f26758a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:42.791152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f4ccb3d7-afad-4d35-9a60-43e8f26758a1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:42.792446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f4ccb3d7-afad-4d35-9a60-43e8f26758a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:42.807193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:42.867204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 159/320] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:42.890336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166cfa8-3cca-4635-9d4b-574f8a0b3149 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:42.935773 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:42.998343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166cfa8-3cca-4635-9d4b-574f8a0b3149 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:43.037139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246751b2-1da5-4047-96ad-1df63e34b04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:43.037852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246751b2-1da5-4047-96ad-1df63e34b04f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.038136 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246751b2-1da5-4047-96ad-1df63e34b04f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.038416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246751b2-1da5-4047-96ad-1df63e34b04f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.039590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246751b2-1da5-4047-96ad-1df63e34b04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:43.041029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246751b2-1da5-4047-96ad-1df63e34b04f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:43.047129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 162/321] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:32:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:43.048351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccb3d7-afad-4d35-9a60-43e8f26758a1 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:43.055892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f20e6f-5498-4cc1-9a90-557df7556142 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.056181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f20e6f-5498-4cc1-9a90-557df7556142 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.056461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f20e6f-5498-4cc1-9a90-557df7556142 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.057925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 163/322] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:32:43.064143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa25d9-9aed-4e8d-af00-fadddd98b87e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.064439 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa25d9-9aed-4e8d-af00-fadddd98b87e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.064718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa25d9-9aed-4e8d-af00-fadddd98b87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.083247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-bcfa25d9-9aed-4e8d-af00-fadddd98b87e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:43.084528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-bcfa25d9-9aed-4e8d-af00-fadddd98b87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:43.160381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccb3d7-afad-4d35-9a60-43e8f26758a1 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:43.160866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 164/323] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:43.162076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbea49-161f-4e49-9d0d-7858b601162e None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.162366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbea49-161f-4e49-9d0d-7858b601162e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.162643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbea49-161f-4e49-9d0d-7858b601162e None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.164045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 165/324] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:43.168877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df605891-4744-4418-a808-02e240153282 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.169168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df605891-4744-4418-a808-02e240153282 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.169447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df605891-4744-4418-a808-02e240153282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.185738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-df605891-4744-4418-a808-02e240153282 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:43.187233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-df605891-4744-4418-a808-02e240153282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:43.194297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c6a60-a572-4eab-8bda-2b46d338cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:43.194967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c6a60-a572-4eab-8bda-2b46d338cc76 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.195250 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c6a60-a572-4eab-8bda-2b46d338cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.195565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c6a60-a572-4eab-8bda-2b46d338cc76 None admin] PATH_INFO: `/v3/groups` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.196249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c6a60-a572-4eab-8bda-2b46d338cc76 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:43.197688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c6a60-a572-4eab-8bda-2b46d338cc76 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:43.222176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:43.253103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 166/325] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:43.253906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df605891-4744-4418-a808-02e240153282 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:43.297210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 160/326] 10.222.0.78 () {60 vars in 1134 bytes} [Fri Jun 17 08:32:43 2022] POST /identity/v3/groups => generated 226 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:32:43.297813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c6a60-a572-4eab-8bda-2b46d338cc76 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:43.310099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:43.360894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df605891-4744-4418-a808-02e240153282 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:43.400646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad7ea2-0a3a-4cfc-b6d6-4c01796536d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:43.401565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad7ea2-0a3a-4cfc-b6d6-4c01796536d6 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.401873 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad7ea2-0a3a-4cfc-b6d6-4c01796536d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.402121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad7ea2-0a3a-4cfc-b6d6-4c01796536d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.411552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c6a60-a572-4eab-8bda-2b46d338cc76 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:43.417427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad7ea2-0a3a-4cfc-b6d6-4c01796536d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-53ad7ea2-0a3a-4cfc-b6d6-4c01796536d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:43.425682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:43.426809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:43.427653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 167/327] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:43.432730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad7ea2-0a3a-4cfc-b6d6-4c01796536d6 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:43.504212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:43.508013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a68e0-3107-46ca-9e3a-dce8baacf122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:43.508812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a68e0-3107-46ca-9e3a-dce8baacf122 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.509095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a68e0-3107-46ca-9e3a-dce8baacf122 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.509369 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a68e0-3107-46ca-9e3a-dce8baacf122 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.521942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a68e0-3107-46ca-9e3a-dce8baacf122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-3f6a68e0-3107-46ca-9e3a-dce8baacf122 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:43.530021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:43.530967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:43.531802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 161/328] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:43.538080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a68e0-3107-46ca-9e3a-dce8baacf122 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:43.597225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad7ea2-0a3a-4cfc-b6d6-4c01796536d6 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:43.614241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:43.646983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54dd3-9d61-45de-a70b-21ac4ca90a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:43.648316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54dd3-9d61-45de-a70b-21ac4ca90a31 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.649003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54dd3-9d61-45de-a70b-21ac4ca90a31 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.649422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54dd3-9d61-45de-a70b-21ac4ca90a31 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.650492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d54dd3-9d61-45de-a70b-21ac4ca90a31 None admin] RBAC: Adding query filter params (name=member) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:43.651222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d54dd3-9d61-45de-a70b-21ac4ca90a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:43.653195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d54dd3-9d61-45de-a70b-21ac4ca90a31 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:43.660527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a68e0-3107-46ca-9e3a-dce8baacf122 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:43.664966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 168/329] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:43.673264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54dd3-9d61-45de-a70b-21ac4ca90a31 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:43.711896 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594183e-3baa-4297-a29c-e413afba2de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:43.712580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594183e-3baa-4297-a29c-e413afba2de9 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.712864 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594183e-3baa-4297-a29c-e413afba2de9 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.713148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594183e-3baa-4297-a29c-e413afba2de9 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.713905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594183e-3baa-4297-a29c-e413afba2de9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:43.714215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594183e-3baa-4297-a29c-e413afba2de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:43.715677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594183e-3baa-4297-a29c-e413afba2de9 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:43.727580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 162/330] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:43.734458 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594183e-3baa-4297-a29c-e413afba2de9 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:43.801856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:43.813395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54dd3-9d61-45de-a70b-21ac4ca90a31 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:43.864450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac94038-e124-4576-995e-875242d74bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:43.865258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac94038-e124-4576-995e-875242d74bbc None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.865542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac94038-e124-4576-995e-875242d74bbc None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.865650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594183e-3baa-4297-a29c-e413afba2de9 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:43.866048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac94038-e124-4576-995e-875242d74bbc None admin] PATH_INFO: `/v3/users/1c38e79df815440d84af5a313e46a277` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac94038-e124-4576-995e-875242d74bbc None admin] RBAC: Authorizing `identity:get_user(user_id=1c38e79df815440d84af5a313e46a277)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:43.869711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac94038-e124-4576-995e-875242d74bbc None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:43.871403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 169/331] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:43 2022] GET /identity/v3/users/1c38e79df815440d84af5a313e46a277 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:43.879482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac94038-e124-4576-995e-875242d74bbc None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:43.899604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:43.907140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3287ee5-0fc1-43ee-8516-ae8f9fbf5455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:43.908072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3287ee5-0fc1-43ee-8516-ae8f9fbf5455 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:43.908355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3287ee5-0fc1-43ee-8516-ae8f9fbf5455 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:43.908631 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3287ee5-0fc1-43ee-8516-ae8f9fbf5455 None admin] PATH_INFO: `/v3/users/b22b51aad54240a9ada8877bf1626d93` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:43.909887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3287ee5-0fc1-43ee-8516-ae8f9fbf5455 None admin] RBAC: Authorizing `identity:get_user(user_id=b22b51aad54240a9ada8877bf1626d93)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:43.911636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3287ee5-0fc1-43ee-8516-ae8f9fbf5455 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:43.913278 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 163/332] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:43 2022] GET /identity/v3/users/b22b51aad54240a9ada8877bf1626d93 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:43.918735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3287ee5-0fc1-43ee-8516-ae8f9fbf5455 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:44.019284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac94038-e124-4576-995e-875242d74bbc None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:44.042217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3287ee5-0fc1-43ee-8516-ae8f9fbf5455 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:44.063464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ec0cb-c471-4357-a731-d289529507c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:44.064388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ec0cb-c471-4357-a731-d289529507c5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:44.064673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ec0cb-c471-4357-a731-d289529507c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:44.064950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ec0cb-c471-4357-a731-d289529507c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:44.065788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ec0cb-c471-4357-a731-d289529507c5 None admin] RBAC: Adding query filter params (role.id=0b03acccb970430e8e3b5a7921cb70d0, user.id=1c38e79df815440d84af5a313e46a277, scope.system=all) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:44.066102 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ec0cb-c471-4357-a731-d289529507c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:44.067960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ec0cb-c471-4357-a731-d289529507c5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:44.084277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 170/333] 10.222.0.78 () {56 vars in 1308 bytes} [Fri Jun 17 08:32:43 2022] GET /identity/v3/role_assignments?user.id=1c38e79df815440d84af5a313e46a277&scope.system=all&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:44.096459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153616e4-07b2-4f59-bb64-3dfdcd090327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:44.097357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153616e4-07b2-4f59-bb64-3dfdcd090327 None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:44.097640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153616e4-07b2-4f59-bb64-3dfdcd090327 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:44.097919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153616e4-07b2-4f59-bb64-3dfdcd090327 None admin] PATH_INFO: `/v3/system/users/b22b51aad54240a9ada8877bf1626d93/roles/9ee3b802458741a6be937b8b8dcdc3f6` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:44.099574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153616e4-07b2-4f59-bb64-3dfdcd090327 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b22b51aad54240a9ada8877bf1626d93, role_id=9ee3b802458741a6be937b8b8dcdc3f6)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:44.101036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153616e4-07b2-4f59-bb64-3dfdcd090327 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:44.163975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 164/334] 10.222.0.78 () {58 vars in 1334 bytes} [Fri Jun 17 08:32:43 2022] PUT /identity/v3/system/users/b22b51aad54240a9ada8877bf1626d93/roles/9ee3b802458741a6be937b8b8dcdc3f6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:32:45.775482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31f480-b751-4975-a490-7772de8e4f28 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:45.776046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31f480-b751-4975-a490-7772de8e4f28 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:45.776046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31f480-b751-4975-a490-7772de8e4f28 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:45.777542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 171/335] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:45.783324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f846e-7e5b-4705-8417-caebfa6802ad None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:45.784181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f846e-7e5b-4705-8417-caebfa6802ad None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:45.784656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f846e-7e5b-4705-8417-caebfa6802ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:45.801998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-1e3f846e-7e5b-4705-8417-caebfa6802ad None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:45.803565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1e3f846e-7e5b-4705-8417-caebfa6802ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:45.873965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:45.884276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 165/336] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:45.919495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31f480-b751-4975-a490-7772de8e4f28 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:45.950721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:46.051086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31f480-b751-4975-a490-7772de8e4f28 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:46.100102 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21550da-97b8-4c8e-b2d9-72160da4b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:46.100906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21550da-97b8-4c8e-b2d9-72160da4b4fa None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:46.101182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21550da-97b8-4c8e-b2d9-72160da4b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:46.101458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21550da-97b8-4c8e-b2d9-72160da4b4fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:46.120060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21550da-97b8-4c8e-b2d9-72160da4b4fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:46.125838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8ae7-5a06-4d66-acbd-ef06d5ea2796 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:46.126121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8ae7-5a06-4d66-acbd-ef06d5ea2796 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:46.126399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8ae7-5a06-4d66-acbd-ef06d5ea2796 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:46.127950 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 166/337] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-e21550da-97b8-4c8e-b2d9-72160da4b4fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:46.132450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:46.133349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:46.134185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 172/338] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:46.136733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51fabb-3d09-459a-ab9c-456d86f7240b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:46.137021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51fabb-3d09-459a-ab9c-456d86f7240b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:46.137307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51fabb-3d09-459a-ab9c-456d86f7240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:46.139264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21550da-97b8-4c8e-b2d9-72160da4b4fa None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:46.167306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5e51fabb-3d09-459a-ab9c-456d86f7240b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:46.168600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5e51fabb-3d09-459a-ab9c-456d86f7240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:46.225239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:46.250871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21550da-97b8-4c8e-b2d9-72160da4b4fa None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:46.305218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a05b87-af1f-4e5d-aa23-9e4781da3350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:46.305932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a05b87-af1f-4e5d-aa23-9e4781da3350 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:46.306273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a05b87-af1f-4e5d-aa23-9e4781da3350 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:46.306617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a05b87-af1f-4e5d-aa23-9e4781da3350 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:46.307577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a05b87-af1f-4e5d-aa23-9e4781da3350 None admin] RBAC: Adding query filter params (name=member) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:46.308021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a05b87-af1f-4e5d-aa23-9e4781da3350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:46.309525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a05b87-af1f-4e5d-aa23-9e4781da3350 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:46.325707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 173/339] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:46.330383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a05b87-af1f-4e5d-aa23-9e4781da3350 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:46.350493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 167/340] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:46.481706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51fabb-3d09-459a-ab9c-456d86f7240b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:46.524945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a05b87-af1f-4e5d-aa23-9e4781da3350 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:46.580798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e44f14-7b25-41a8-bdf4-a3aa5c32a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:46.581388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e44f14-7b25-41a8-bdf4-a3aa5c32a7ec None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:46.581802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e44f14-7b25-41a8-bdf4-a3aa5c32a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:46.582084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e44f14-7b25-41a8-bdf4-a3aa5c32a7ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:46.602894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:46.698423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51fabb-3d09-459a-ab9c-456d86f7240b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:46.703031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e44f14-7b25-41a8-bdf4-a3aa5c32a7ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:46.704534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e44f14-7b25-41a8-bdf4-a3aa5c32a7ec None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:46.740319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:46.771000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6c5de-daf4-4cc5-be5c-52489a00e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:46.771944 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6c5de-daf4-4cc5-be5c-52489a00e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:46.772538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6c5de-daf4-4cc5-be5c-52489a00e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:46.772821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6c5de-daf4-4cc5-be5c-52489a00e1d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:46.804547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6c5de-daf4-4cc5-be5c-52489a00e1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-5ad6c5de-daf4-4cc5-be5c-52489a00e1d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:46.813223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:46.814181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:46.814978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 168/341] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:46.824059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6c5de-daf4-4cc5-be5c-52489a00e1d9 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:46.846513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 174/342] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:32:46.853402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e44f14-7b25-41a8-bdf4-a3aa5c32a7ec None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:46.914866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:46.986405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6c5de-daf4-4cc5-be5c-52489a00e1d9 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:47.037570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619bc57-6aed-43f5-ae0b-86471e1169a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:47.038269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619bc57-6aed-43f5-ae0b-86471e1169a0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:47.038552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619bc57-6aed-43f5-ae0b-86471e1169a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:47.038827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619bc57-6aed-43f5-ae0b-86471e1169a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:47.039666 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619bc57-6aed-43f5-ae0b-86471e1169a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:47.040043 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619bc57-6aed-43f5-ae0b-86471e1169a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:47.042030 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619bc57-6aed-43f5-ae0b-86471e1169a0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:47.057747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 169/343] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:47.065053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619bc57-6aed-43f5-ae0b-86471e1169a0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:47.093757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e44f14-7b25-41a8-bdf4-a3aa5c32a7ec None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:47.161911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:47.187664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91f3e1-eccf-4b43-b5ac-e20fade01193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:47.188997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91f3e1-eccf-4b43-b5ac-e20fade01193 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:47.189482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91f3e1-eccf-4b43-b5ac-e20fade01193 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:47.189969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91f3e1-eccf-4b43-b5ac-e20fade01193 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:47.195608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91f3e1-eccf-4b43-b5ac-e20fade01193 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:47.197379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91f3e1-eccf-4b43-b5ac-e20fade01193 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:47.199759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 175/344] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:46 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:47.205638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91f3e1-eccf-4b43-b5ac-e20fade01193 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:47.256700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619bc57-6aed-43f5-ae0b-86471e1169a0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:47.326266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7b9c4-057c-406d-94ba-3aad2224978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:47.326940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7b9c4-057c-406d-94ba-3aad2224978d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:47.327798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7b9c4-057c-406d-94ba-3aad2224978d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:47.328081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7b9c4-057c-406d-94ba-3aad2224978d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:47.454809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7b9c4-057c-406d-94ba-3aad2224978d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:47.456385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7b9c4-057c-406d-94ba-3aad2224978d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:47.498550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91f3e1-eccf-4b43-b5ac-e20fade01193 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:47.522997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:47.556492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:47.573396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80af37-b02f-4223-a107-aaf4f46d1769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:47.576075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80af37-b02f-4223-a107-aaf4f46d1769 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:47.576579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80af37-b02f-4223-a107-aaf4f46d1769 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:47.577600 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80af37-b02f-4223-a107-aaf4f46d1769 None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:47.589626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80af37-b02f-4223-a107-aaf4f46d1769 None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:47.593395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80af37-b02f-4223-a107-aaf4f46d1769 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:47.599813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 176/345] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:47 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:47.602989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057ec2-90cf-4233-b886-f4857ca17171 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:47.604651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057ec2-90cf-4233-b886-f4857ca17171 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:47.605142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057ec2-90cf-4233-b886-f4857ca17171 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:47.606911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 177/346] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:47.611134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057ec2-90cf-4233-b886-f4857ca17171 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:47.677812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 170/347] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:32:47.680279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5614-2320-41a1-8481-031e3dd03dbf None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:47.680979 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5614-2320-41a1-8481-031e3dd03dbf None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:47.682711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5614-2320-41a1-8481-031e3dd03dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:47.710537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-32bf5614-2320-41a1-8481-031e3dd03dbf None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:47.712317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-32bf5614-2320-41a1-8481-031e3dd03dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:47.794290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 171/348] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:47.795259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf5614-2320-41a1-8481-031e3dd03dbf None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:47.807084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057ec2-90cf-4233-b886-f4857ca17171 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:47.864623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248da1dd-6a0e-4224-a4fe-910228b34fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:47.866366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248da1dd-6a0e-4224-a4fe-910228b34fe9 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:47.866796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248da1dd-6a0e-4224-a4fe-910228b34fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:47.867500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248da1dd-6a0e-4224-a4fe-910228b34fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:47.869193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248da1dd-6a0e-4224-a4fe-910228b34fe9 None admin] RBAC: Adding query filter params (group.id=a60d9cb1eb494e5abd8f1ee92ceace43, role.id=0b03acccb970430e8e3b5a7921cb70d0, scope.project.id=82e4708d10bd4a56b8c263303c8beb29) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:47.869688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248da1dd-6a0e-4224-a4fe-910228b34fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:47.871967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248da1dd-6a0e-4224-a4fe-910228b34fe9 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:47.883537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 178/349] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Jun 17 08:32:47 2022] GET /identity/v3/role_assignments?group.id=a60d9cb1eb494e5abd8f1ee92ceace43&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:47.884619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb7f8-3038-4b69-b20d-166d024a2917 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:47.884906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb7f8-3038-4b69-b20d-166d024a2917 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:47.885182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb7f8-3038-4b69-b20d-166d024a2917 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:47.886717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 179/350] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:47.888185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bb7f8-3038-4b69-b20d-166d024a2917 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:47.937459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:47.944960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:47.986270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf5614-2320-41a1-8481-031e3dd03dbf None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:48.032573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146d78e-bd90-4ece-ac16-a5da7d456d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:48.033872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146d78e-bd90-4ece-ac16-a5da7d456d75 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.034354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146d78e-bd90-4ece-ac16-a5da7d456d75 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.034822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146d78e-bd90-4ece-ac16-a5da7d456d75 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.036606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146d78e-bd90-4ece-ac16-a5da7d456d75 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:48.037204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bb7f8-3038-4b69-b20d-166d024a2917 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:48.038565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146d78e-bd90-4ece-ac16-a5da7d456d75 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:48.040596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 172/351] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:47 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:48.044293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc7658-b4f0-4b00-a14d-205e137860a4 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.044819 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc7658-b4f0-4b00-a14d-205e137860a4 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.045293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc7658-b4f0-4b00-a14d-205e137860a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.064385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8fdc7658-b4f0-4b00-a14d-205e137860a4 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:48.065943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8fdc7658-b4f0-4b00-a14d-205e137860a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:48.078812 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd7422-7485-4c33-b07a-a0eacc9f12d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:48.079740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd7422-7485-4c33-b07a-a0eacc9f12d9 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.080297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd7422-7485-4c33-b07a-a0eacc9f12d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.080297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd7422-7485-4c33-b07a-a0eacc9f12d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.092499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd7422-7485-4c33-b07a-a0eacc9f12d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-31bd7422-7485-4c33-b07a-a0eacc9f12d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:48.100754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:48.101677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:48.102500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 180/352] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:48.103724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81351678-0fbf-425d-b29d-4301ffe370de None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.103724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81351678-0fbf-425d-b29d-4301ffe370de None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.103959 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81351678-0fbf-425d-b29d-4301ffe370de None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.105258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 181/353] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:48.106041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81351678-0fbf-425d-b29d-4301ffe370de None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:48.150004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 173/354] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:48.151646 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99840e-ecfe-44d4-8a05-cc4bcd5fe50f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.152132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99840e-ecfe-44d4-8a05-cc4bcd5fe50f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.152619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99840e-ecfe-44d4-8a05-cc4bcd5fe50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.169403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ea99840e-ecfe-44d4-8a05-cc4bcd5fe50f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:48.170916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ea99840e-ecfe-44d4-8a05-cc4bcd5fe50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:48.235766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:48.240723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81351678-0fbf-425d-b29d-4301ffe370de None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:48.255048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 174/355] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:48.256266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99840e-ecfe-44d4-8a05-cc4bcd5fe50f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:48.258716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:48.287707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94ffc-230f-4ebe-bc09-3f082ef687e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:48.288580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94ffc-230f-4ebe-bc09-3f082ef687e1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.289329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94ffc-230f-4ebe-bc09-3f082ef687e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.289761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94ffc-230f-4ebe-bc09-3f082ef687e1 None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.291327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94ffc-230f-4ebe-bc09-3f082ef687e1 None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:48.293721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94ffc-230f-4ebe-bc09-3f082ef687e1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:48.296754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 182/356] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:48 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:48.297676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94ffc-230f-4ebe-bc09-3f082ef687e1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:48.403587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99840e-ecfe-44d4-8a05-cc4bcd5fe50f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:48.439184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94ffc-230f-4ebe-bc09-3f082ef687e1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:48.455461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9934dc-d1a0-48ba-901e-00485b8371db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:48.456291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9934dc-d1a0-48ba-901e-00485b8371db None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.456731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9934dc-d1a0-48ba-901e-00485b8371db None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.457012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9934dc-d1a0-48ba-901e-00485b8371db None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.457877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9934dc-d1a0-48ba-901e-00485b8371db None admin] RBAC: Adding query filter params (name=member) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:48.458191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9934dc-d1a0-48ba-901e-00485b8371db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:48.459973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9934dc-d1a0-48ba-901e-00485b8371db None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:48.472094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 175/357] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:48.477389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9934dc-d1a0-48ba-901e-00485b8371db None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:48.482899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5e910-67d5-4505-88f9-ebd13b6b8beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:48.484352 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5e910-67d5-4505-88f9-ebd13b6b8beb None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.484641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5e910-67d5-4505-88f9-ebd13b6b8beb None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.484925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5e910-67d5-4505-88f9-ebd13b6b8beb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.498705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5e910-67d5-4505-88f9-ebd13b6b8beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-02b5e910-67d5-4505-88f9-ebd13b6b8beb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:48.509421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:48.510328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:48.511117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 183/358] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:48.511817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5e910-67d5-4505-88f9-ebd13b6b8beb None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:48.546139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:48.565000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:48.613044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9934dc-d1a0-48ba-901e-00485b8371db None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:48.648433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5e910-67d5-4505-88f9-ebd13b6b8beb None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:48.666000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db9564-fa2a-4116-ac34-e13e58e8a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:48.666846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db9564-fa2a-4116-ac34-e13e58e8a636 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.667130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db9564-fa2a-4116-ac34-e13e58e8a636 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.667458 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db9564-fa2a-4116-ac34-e13e58e8a636 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.682054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db9564-fa2a-4116-ac34-e13e58e8a636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-58db9564-fa2a-4116-ac34-e13e58e8a636 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:48.693165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:48.694036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:48.694823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:48.696672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 176/359] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:48.701665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d164713-1a2c-46a1-955a-665ddfd03899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:48.702650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d164713-1a2c-46a1-955a-665ddfd03899 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.703196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d164713-1a2c-46a1-955a-665ddfd03899 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.703394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db9564-fa2a-4116-ac34-e13e58e8a636 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:48.703950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d164713-1a2c-46a1-955a-665ddfd03899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.705159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d164713-1a2c-46a1-955a-665ddfd03899 None admin] RBAC: Adding query filter params (group.id=a60d9cb1eb494e5abd8f1ee92ceace43, role.id=3ef6518e7cfb491dab86c245c0aeac21, scope.project.id=82e4708d10bd4a56b8c263303c8beb29) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:48.705679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d164713-1a2c-46a1-955a-665ddfd03899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:48.707742 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d164713-1a2c-46a1-955a-665ddfd03899 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:48.717158 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 184/360] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Jun 17 08:32:48 2022] GET /identity/v3/role_assignments?group.id=a60d9cb1eb494e5abd8f1ee92ceace43&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=3ef6518e7cfb491dab86c245c0aeac21 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:48.717158 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d164713-1a2c-46a1-955a-665ddfd03899 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:48.843916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:48.864886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d164713-1a2c-46a1-955a-665ddfd03899 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:48.866008 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db9564-fa2a-4116-ac34-e13e58e8a636 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:48.907927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:48.922930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d99b9c-c1be-44d9-8628-970f978c09f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:48.924049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d99b9c-c1be-44d9-8628-970f978c09f6 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.924049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d99b9c-c1be-44d9-8628-970f978c09f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.924792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d99b9c-c1be-44d9-8628-970f978c09f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.930015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01203-d06c-4e83-a897-7d45076f150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:48.930661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01203-d06c-4e83-a897-7d45076f150b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:48.930944 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01203-d06c-4e83-a897-7d45076f150b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:48.931271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01203-d06c-4e83-a897-7d45076f150b None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:48.932011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01203-d06c-4e83-a897-7d45076f150b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:48.932317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01203-d06c-4e83-a897-7d45076f150b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:48.933716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01203-d06c-4e83-a897-7d45076f150b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:48.943583 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 185/361] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:48.948249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01203-d06c-4e83-a897-7d45076f150b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:49.015045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d99b9c-c1be-44d9-8628-970f978c09f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:49.017434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d99b9c-c1be-44d9-8628-970f978c09f6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:49.070328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01203-d06c-4e83-a897-7d45076f150b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:49.114907 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d227b-6ff5-4f5d-a245-7eab919108ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:49.115523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d227b-6ff5-4f5d-a245-7eab919108ba None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:49.115893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d227b-6ff5-4f5d-a245-7eab919108ba None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:49.116183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d227b-6ff5-4f5d-a245-7eab919108ba None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:49.117104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d227b-6ff5-4f5d-a245-7eab919108ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:49.117418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d227b-6ff5-4f5d-a245-7eab919108ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:49.119543 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d227b-6ff5-4f5d-a245-7eab919108ba None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:49.131272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 186/362] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:49.132728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018edb9-9562-468d-9c2b-ed3aa3844c80 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:49.133021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018edb9-9562-468d-9c2b-ed3aa3844c80 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:49.133305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018edb9-9562-468d-9c2b-ed3aa3844c80 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:49.134921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 187/363] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:49.135780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018edb9-9562-468d-9c2b-ed3aa3844c80 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:49.156220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:49.172371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 177/364] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:49.173517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d99b9c-c1be-44d9-8628-970f978c09f6 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:49.200238 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:49.255938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018edb9-9562-468d-9c2b-ed3aa3844c80 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:49.291758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d99b9c-c1be-44d9-8628-970f978c09f6 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:49.294112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b30fba-c342-489f-85ca-8aeb11a3672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:49.295153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b30fba-c342-489f-85ca-8aeb11a3672d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:49.295604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b30fba-c342-489f-85ca-8aeb11a3672d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:49.296536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b30fba-c342-489f-85ca-8aeb11a3672d None admin] PATH_INFO: `/v3/users/b22b51aad54240a9ada8877bf1626d93` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:49.297997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b30fba-c342-489f-85ca-8aeb11a3672d None admin] RBAC: Authorizing `identity:get_user(user_id=b22b51aad54240a9ada8877bf1626d93)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:49.299733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b30fba-c342-489f-85ca-8aeb11a3672d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:49.301656 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 188/365] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:32:49 2022] GET /identity/v3/users/b22b51aad54240a9ada8877bf1626d93 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:49.307726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783a2d-512d-45bb-870c-1a123576434e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:49.308249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783a2d-512d-45bb-870c-1a123576434e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:49.308673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783a2d-512d-45bb-870c-1a123576434e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:49.327772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-fa783a2d-512d-45bb-870c-1a123576434e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:49.329195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-fa783a2d-512d-45bb-870c-1a123576434e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:49.331037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938a739-8120-4be3-83f5-76145e3150b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:49.331838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a739-8120-4be3-83f5-76145e3150b6 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:49.332129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a739-8120-4be3-83f5-76145e3150b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:49.332410 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938a739-8120-4be3-83f5-76145e3150b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:49.405687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 189/366] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:49.407215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783a2d-512d-45bb-870c-1a123576434e None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:49.419455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:49.421712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938a739-8120-4be3-83f5-76145e3150b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:49.423663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938a739-8120-4be3-83f5-76145e3150b6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:49.460149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:49.518693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783a2d-512d-45bb-870c-1a123576434e None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:49.556655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087ea2-3c0c-4dc1-afa4-776637c689f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:49.557521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087ea2-3c0c-4dc1-afa4-776637c689f4 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:49.557807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087ea2-3c0c-4dc1-afa4-776637c689f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:49.558082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087ea2-3c0c-4dc1-afa4-776637c689f4 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:49.559289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5087ea2-3c0c-4dc1-afa4-776637c689f4 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:49.559518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 178/367] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:49.560303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938a739-8120-4be3-83f5-76145e3150b6 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:49.566315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5087ea2-3c0c-4dc1-afa4-776637c689f4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:49.569845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 190/368] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:49 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:49.570762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087ea2-3c0c-4dc1-afa4-776637c689f4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:49.661162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:49.674917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938a739-8120-4be3-83f5-76145e3150b6 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:49.685605 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087ea2-3c0c-4dc1-afa4-776637c689f4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:49.700119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:49.715955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dae42-fa94-42ed-bbbb-beaaf75f3722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:49.716896 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dae42-fa94-42ed-bbbb-beaaf75f3722 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:49.717185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dae42-fa94-42ed-bbbb-beaaf75f3722 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:49.718397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dae42-fa94-42ed-bbbb-beaaf75f3722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:49.719855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dae42-fa94-42ed-bbbb-beaaf75f3722 None admin] RBAC: Adding query filter params (role.id=9ee3b802458741a6be937b8b8dcdc3f6, user.id=b22b51aad54240a9ada8877bf1626d93, scope.system=all) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:49.720682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dae42-fa94-42ed-bbbb-beaaf75f3722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:49.722451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dae42-fa94-42ed-bbbb-beaaf75f3722 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:49.725185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa77cd6-22c8-4e4c-acc1-dc14f409b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:49.725983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa77cd6-22c8-4e4c-acc1-dc14f409b58b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:49.726266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa77cd6-22c8-4e4c-acc1-dc14f409b58b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:49.726548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa77cd6-22c8-4e4c-acc1-dc14f409b58b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:49.738555 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 179/369] 10.222.0.78 () {56 vars in 1308 bytes} [Fri Jun 17 08:32:49 2022] GET /identity/v3/role_assignments?user.id=b22b51aad54240a9ada8877bf1626d93&scope.system=all&role.id=9ee3b802458741a6be937b8b8dcdc3f6 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:49.739450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dae42-fa94-42ed-bbbb-beaaf75f3722 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:49.750126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa77cd6-22c8-4e4c-acc1-dc14f409b58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-7aa77cd6-22c8-4e4c-acc1-dc14f409b58b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:49.758167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:49.760224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:49.762151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:49.771378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 191/370] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:49.771378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa77cd6-22c8-4e4c-acc1-dc14f409b58b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:49.880761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dae42-fa94-42ed-bbbb-beaaf75f3722 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:49.927605 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f9811-ca12-40d7-9269-361d4145abb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:49.928423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f9811-ca12-40d7-9269-361d4145abb6 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:49.928709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f9811-ca12-40d7-9269-361d4145abb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:49.928991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f9811-ca12-40d7-9269-361d4145abb6 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:49.930266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f9811-ca12-40d7-9269-361d4145abb6 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:49.931763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f9811-ca12-40d7-9269-361d4145abb6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:49.934080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 180/371] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:49 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:49.935080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f9811-ca12-40d7-9269-361d4145abb6 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:49.998430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa77cd6-22c8-4e4c-acc1-dc14f409b58b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:50.008572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:50.068650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f9811-ca12-40d7-9269-361d4145abb6 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:50.084182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17746568-886e-45ea-9dae-3a5a7aafc09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:50.085359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17746568-886e-45ea-9dae-3a5a7aafc09e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:50.085781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17746568-886e-45ea-9dae-3a5a7aafc09e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:50.086224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17746568-886e-45ea-9dae-3a5a7aafc09e None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:50.087836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17746568-886e-45ea-9dae-3a5a7aafc09e None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:50.090674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17746568-886e-45ea-9dae-3a5a7aafc09e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:50.093560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 192/372] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:49 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:50.094808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17746568-886e-45ea-9dae-3a5a7aafc09e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:50.105252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:50.110796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98233252-27b0-4df0-abfb-e63fe33576df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:50.111990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98233252-27b0-4df0-abfb-e63fe33576df None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:50.117547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98233252-27b0-4df0-abfb-e63fe33576df None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:50.117547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98233252-27b0-4df0-abfb-e63fe33576df None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:50.117547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98233252-27b0-4df0-abfb-e63fe33576df None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:50.117547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98233252-27b0-4df0-abfb-e63fe33576df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:50.117547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98233252-27b0-4df0-abfb-e63fe33576df None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:50.124542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 181/373] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:50.125546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98233252-27b0-4df0-abfb-e63fe33576df None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:50.216947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17746568-886e-45ea-9dae-3a5a7aafc09e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:50.238145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98233252-27b0-4df0-abfb-e63fe33576df None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:50.254362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:50.257100 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d94d4-d462-4a9f-8698-34e2016137d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:50.257974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d94d4-d462-4a9f-8698-34e2016137d6 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:50.258260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d94d4-d462-4a9f-8698-34e2016137d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:50.258540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d94d4-d462-4a9f-8698-34e2016137d6 None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:50.259878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d94d4-d462-4a9f-8698-34e2016137d6 None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:50.269268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d94d4-d462-4a9f-8698-34e2016137d6 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:50.269268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 193/374] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:50 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:50.269268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d94d4-d462-4a9f-8698-34e2016137d6 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:50.278630 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38c741-b2ff-4e08-9f12-9b157825e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:50.279614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38c741-b2ff-4e08-9f12-9b157825e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:50.280756 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38c741-b2ff-4e08-9f12-9b157825e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:50.281253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38c741-b2ff-4e08-9f12-9b157825e3c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:50.282273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38c741-b2ff-4e08-9f12-9b157825e3c2 None admin] RBAC: Adding query filter params (group.id=a60d9cb1eb494e5abd8f1ee92ceace43, role.id=0b03acccb970430e8e3b5a7921cb70d0, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:50.282774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38c741-b2ff-4e08-9f12-9b157825e3c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:50.284413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38c741-b2ff-4e08-9f12-9b157825e3c2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:50.291017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 182/375] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Jun 17 08:32:50 2022] GET /identity/v3/role_assignments?group.id=a60d9cb1eb494e5abd8f1ee92ceace43&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:50.292116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38c741-b2ff-4e08-9f12-9b157825e3c2 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:50.406276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38c741-b2ff-4e08-9f12-9b157825e3c2 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:50.419453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:50.444518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98d9ea-9e14-4c6a-a98e-69129faf7860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:50.445578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98d9ea-9e14-4c6a-a98e-69129faf7860 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:50.446055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98d9ea-9e14-4c6a-a98e-69129faf7860 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:50.446604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98d9ea-9e14-4c6a-a98e-69129faf7860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:50.447745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98d9ea-9e14-4c6a-a98e-69129faf7860 None admin] RBAC: Adding query filter params (group.id=a60d9cb1eb494e5abd8f1ee92ceace43, role.id=3ef6518e7cfb491dab86c245c0aeac21, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:50.448496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98d9ea-9e14-4c6a-a98e-69129faf7860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:50.450184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98d9ea-9e14-4c6a-a98e-69129faf7860 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:50.458763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 183/376] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Jun 17 08:32:50 2022] GET /identity/v3/role_assignments?group.id=a60d9cb1eb494e5abd8f1ee92ceace43&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=3ef6518e7cfb491dab86c245c0aeac21 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:50.460692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87334ec-c695-4d7f-974a-a6d0b5716f0d None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:50.461202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87334ec-c695-4d7f-974a-a6d0b5716f0d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:50.461697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87334ec-c695-4d7f-974a-a6d0b5716f0d None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:50.463513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 184/377] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:50.481958 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846634f-9cac-424c-b84c-bf4014731dd2 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:50.482564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846634f-9cac-424c-b84c-bf4014731dd2 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:50.483038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846634f-9cac-424c-b84c-bf4014731dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:50.492467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d94d4-d462-4a9f-8698-34e2016137d6 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:50.520053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-a846634f-9cac-424c-b84c-bf4014731dd2 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:50.522563 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a846634f-9cac-424c-b84c-bf4014731dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:50.563152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5f034-9523-4f62-b8e3-685bd32a16a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:50.563910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5f034-9523-4f62-b8e3-685bd32a16a2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:50.564192 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5f034-9523-4f62-b8e3-685bd32a16a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:50.564470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5f034-9523-4f62-b8e3-685bd32a16a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:50.591405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:50.652215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 185/378] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:50.668849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5f034-9523-4f62-b8e3-685bd32a16a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:50.670876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5f034-9523-4f62-b8e3-685bd32a16a2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:50.700032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846634f-9cac-424c-b84c-bf4014731dd2 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:50.797896 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:50.847377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 194/379] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:50.854212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5f034-9523-4f62-b8e3-685bd32a16a2 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:50.883533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846634f-9cac-424c-b84c-bf4014731dd2 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:50.950137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4cdfa-811a-43cf-8cb6-c11defbd4ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:50.951632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4cdfa-811a-43cf-8cb6-c11defbd4ab9 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:50.952134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4cdfa-811a-43cf-8cb6-c11defbd4ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:50.952597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4cdfa-811a-43cf-8cb6-c11defbd4ab9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:50.972254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4cdfa-811a-43cf-8cb6-c11defbd4ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-eca4cdfa-811a-43cf-8cb6-c11defbd4ab9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:50.981617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:50.982504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:50.983943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:50.992918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 186/380] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:51.000484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4cdfa-811a-43cf-8cb6-c11defbd4ab9 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:51.039098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5f034-9523-4f62-b8e3-685bd32a16a2 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:51.057251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:51.104846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f0481-7325-449f-93f6-a3b9c5aa7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:51.106200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0481-7325-449f-93f6-a3b9c5aa7502 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:51.106676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0481-7325-449f-93f6-a3b9c5aa7502 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:51.107152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0481-7325-449f-93f6-a3b9c5aa7502 None admin] PATH_INFO: `/v3/projects/9bb6ac161b2c421f94fa26d18ee99634` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:51.109145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f0481-7325-449f-93f6-a3b9c5aa7502 None admin] RBAC: Authorizing `identity:get_project(project_id=9bb6ac161b2c421f94fa26d18ee99634)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:51.110648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f0481-7325-449f-93f6-a3b9c5aa7502 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:51.112591 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 195/381] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:50 2022] GET /identity/v3/projects/9bb6ac161b2c421f94fa26d18ee99634 => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:51.118967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f0481-7325-449f-93f6-a3b9c5aa7502 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:51.181925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4cdfa-811a-43cf-8cb6-c11defbd4ab9 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:51.200860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:51.256618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ca077-21c3-4066-a517-ac1231e80052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:51.257310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ca077-21c3-4066-a517-ac1231e80052 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:51.257592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ca077-21c3-4066-a517-ac1231e80052 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:51.257864 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ca077-21c3-4066-a517-ac1231e80052 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:51.258618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ca077-21c3-4066-a517-ac1231e80052 None admin] RBAC: Adding query filter params (name=member) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:51.258926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ca077-21c3-4066-a517-ac1231e80052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:51.260366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ca077-21c3-4066-a517-ac1231e80052 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:51.274338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 187/382] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:51.279882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ca077-21c3-4066-a517-ac1231e80052 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:51.307727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f0481-7325-449f-93f6-a3b9c5aa7502 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:51.349632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f37f26-8f5d-400e-8a8a-9624d5e0276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:51.350507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37f26-8f5d-400e-8a8a-9624d5e0276f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:51.350790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37f26-8f5d-400e-8a8a-9624d5e0276f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:51.351065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37f26-8f5d-400e-8a8a-9624d5e0276f None admin] PATH_INFO: `/v3/groups/f41b5a86f7264cd6b540ad620d2693c0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:51.356619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f37f26-8f5d-400e-8a8a-9624d5e0276f None admin] RBAC: Authorizing `identity:get_group(group_id=f41b5a86f7264cd6b540ad620d2693c0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:51.358663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f37f26-8f5d-400e-8a8a-9624d5e0276f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:51.360895 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 196/383] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:51 2022] GET /identity/v3/groups/f41b5a86f7264cd6b540ad620d2693c0 => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:51.362043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09af5-f5ac-4cb0-914c-aaa400e2ec40 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:51.362332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09af5-f5ac-4cb0-914c-aaa400e2ec40 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:51.362607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb09af5-f5ac-4cb0-914c-aaa400e2ec40 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:51.364167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 197/384] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:51.366981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb09af5-f5ac-4cb0-914c-aaa400e2ec40 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:51.404352 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:51.415375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ca077-21c3-4066-a517-ac1231e80052 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:51.463591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32797646-d978-44cc-98bb-0f0731ce3453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:51.465513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797646-d978-44cc-98bb-0f0731ce3453 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:51.465900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797646-d978-44cc-98bb-0f0731ce3453 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:51.466268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797646-d978-44cc-98bb-0f0731ce3453 None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:51.468587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32797646-d978-44cc-98bb-0f0731ce3453 None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:51.470359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32797646-d978-44cc-98bb-0f0731ce3453 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:51.472908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 188/385] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:51 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:51.474565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397d1a4-bd1c-4a9a-96ec-1750a40d881e None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:51.477384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397d1a4-bd1c-4a9a-96ec-1750a40d881e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:51.477890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397d1a4-bd1c-4a9a-96ec-1750a40d881e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:51.505169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9397d1a4-bd1c-4a9a-96ec-1750a40d881e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:51.506830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9397d1a4-bd1c-4a9a-96ec-1750a40d881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:51.523042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb09af5-f5ac-4cb0-914c-aaa400e2ec40 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:51.534090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:51.571329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d70c2-25fc-4e33-bed5-0c9dca1c7faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:51.572615 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d70c2-25fc-4e33-bed5-0c9dca1c7faf None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:51.573123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d70c2-25fc-4e33-bed5-0c9dca1c7faf None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:51.573776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d70c2-25fc-4e33-bed5-0c9dca1c7faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:51.575018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d70c2-25fc-4e33-bed5-0c9dca1c7faf None admin] RBAC: Adding query filter params (group.id=f41b5a86f7264cd6b540ad620d2693c0, role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=9bb6ac161b2c421f94fa26d18ee99634) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:51.576219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d70c2-25fc-4e33-bed5-0c9dca1c7faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:51.578824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d70c2-25fc-4e33-bed5-0c9dca1c7faf None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:51.590605 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 198/386] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Jun 17 08:32:51 2022] GET /identity/v3/role_assignments?group.id=f41b5a86f7264cd6b540ad620d2693c0&scope.project.id=9bb6ac161b2c421f94fa26d18ee99634&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:51.592702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d70c2-25fc-4e33-bed5-0c9dca1c7faf None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:51.605030 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 189/387] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:51.637263 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397d1a4-bd1c-4a9a-96ec-1750a40d881e None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:51.783394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d70c2-25fc-4e33-bed5-0c9dca1c7faf None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:51.812550 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:51.818730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365952e-caf9-47d3-b80d-1bccaa926989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:51.819640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365952e-caf9-47d3-b80d-1bccaa926989 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:51.819926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365952e-caf9-47d3-b80d-1bccaa926989 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:51.820203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365952e-caf9-47d3-b80d-1bccaa926989 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:51.821702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365952e-caf9-47d3-b80d-1bccaa926989 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:51.822175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397d1a4-bd1c-4a9a-96ec-1750a40d881e None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:51.823090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365952e-caf9-47d3-b80d-1bccaa926989 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:51.825574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 199/388] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:51 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:51.836421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365952e-caf9-47d3-b80d-1bccaa926989 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:51.866373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d0854-00fb-4fdd-9e9c-0e6fedc28909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:51.867461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d0854-00fb-4fdd-9e9c-0e6fedc28909 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:51.867847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d0854-00fb-4fdd-9e9c-0e6fedc28909 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:51.868271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d0854-00fb-4fdd-9e9c-0e6fedc28909 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:51.883824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:51.900984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d0854-00fb-4fdd-9e9c-0e6fedc28909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-823d0854-00fb-4fdd-9e9c-0e6fedc28909 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:51.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:51.919581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:51.920402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:51.924390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 190/389] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:51.931084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d0854-00fb-4fdd-9e9c-0e6fedc28909 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:51.956982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365952e-caf9-47d3-b80d-1bccaa926989 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:51.994135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5ee7d-a1fe-4898-8666-bf63c8aeeee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:51.995040 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5ee7d-a1fe-4898-8666-bf63c8aeeee4 None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:51.995320 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5ee7d-a1fe-4898-8666-bf63c8aeeee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:51.995634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5ee7d-a1fe-4898-8666-bf63c8aeeee4 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29/groups/a60d9cb1eb494e5abd8f1ee92ceace43/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:52.004309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5ee7d-a1fe-4898-8666-bf63c8aeeee4 None admin] RBAC: Authorizing `identity:create_grant(project_id=82e4708d10bd4a56b8c263303c8beb29, group_id=a60d9cb1eb494e5abd8f1ee92ceace43, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:52.007522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5ee7d-a1fe-4898-8666-bf63c8aeeee4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:52.073738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d0854-00fb-4fdd-9e9c-0e6fedc28909 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:52.084656 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 200/390] 10.222.0.78 () {58 vars in 1442 bytes} [Fri Jun 17 08:32:51 2022] PUT /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29/groups/a60d9cb1eb494e5abd8f1ee92ceace43/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:52.112390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b35a4-e66a-4e7f-b29d-3ca9adb01784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:52.113152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b35a4-e66a-4e7f-b29d-3ca9adb01784 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:52.113440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b35a4-e66a-4e7f-b29d-3ca9adb01784 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:52.113722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b35a4-e66a-4e7f-b29d-3ca9adb01784 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:52.114632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b35a4-e66a-4e7f-b29d-3ca9adb01784 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:52.114952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b35a4-e66a-4e7f-b29d-3ca9adb01784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:52.116585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b35a4-e66a-4e7f-b29d-3ca9adb01784 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:52.126615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 191/391] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:52.132105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5ee7d-a1fe-4898-8666-bf63c8aeeee4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:52.275673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:52.280290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5ee7d-a1fe-4898-8666-bf63c8aeeee4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:52.328160 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50762247-3fd0-4846-ab5d-d4b4151ee534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:52.329723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50762247-3fd0-4846-ab5d-d4b4151ee534 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:52.329723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50762247-3fd0-4846-ab5d-d4b4151ee534 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:52.329723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50762247-3fd0-4846-ab5d-d4b4151ee534 None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:52.331478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50762247-3fd0-4846-ab5d-d4b4151ee534 None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:52.333177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50762247-3fd0-4846-ab5d-d4b4151ee534 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:52.335236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 201/392] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:52 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:52.340776 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b35a4-e66a-4e7f-b29d-3ca9adb01784 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:52.359463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:52.457871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b35a4-e66a-4e7f-b29d-3ca9adb01784 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:52.494813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b1080-8c64-486a-ae1f-3dedf82cf0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:52.495833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b1080-8c64-486a-ae1f-3dedf82cf0f6 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:52.496128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b1080-8c64-486a-ae1f-3dedf82cf0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:52.496528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b1080-8c64-486a-ae1f-3dedf82cf0f6 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:52.497736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b1080-8c64-486a-ae1f-3dedf82cf0f6 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:52.499543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b1080-8c64-486a-ae1f-3dedf82cf0f6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:52.501575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 192/393] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:52 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:52.507123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50762247-3fd0-4846-ab5d-d4b4151ee534 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:52.625916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50762247-3fd0-4846-ab5d-d4b4151ee534 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:52.661728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620d2d3-0981-4211-8f1f-235404d9bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:52.662612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620d2d3-0981-4211-8f1f-235404d9bcd4 None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:52.662893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620d2d3-0981-4211-8f1f-235404d9bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:52.663167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620d2d3-0981-4211-8f1f-235404d9bcd4 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29/groups/a60d9cb1eb494e5abd8f1ee92ceace43/roles/3ef6518e7cfb491dab86c245c0aeac21` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:52.665497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620d2d3-0981-4211-8f1f-235404d9bcd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=82e4708d10bd4a56b8c263303c8beb29, group_id=a60d9cb1eb494e5abd8f1ee92ceace43, role_id=3ef6518e7cfb491dab86c245c0aeac21)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:52.666952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620d2d3-0981-4211-8f1f-235404d9bcd4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:52.749661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 202/394] 10.222.0.78 () {58 vars in 1442 bytes} [Fri Jun 17 08:32:52 2022] PUT /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29/groups/a60d9cb1eb494e5abd8f1ee92ceace43/roles/3ef6518e7cfb491dab86c245c0aeac21 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:53.104212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545ad78-11db-468a-8573-9ce1bc8b8bdf None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:53.104917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545ad78-11db-468a-8573-9ce1bc8b8bdf None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:53.105409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545ad78-11db-468a-8573-9ce1bc8b8bdf None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:53.107190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 193/395] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:53.115083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4867-8f0f-4229-916e-cf2f804fd94c None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:53.115612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4867-8f0f-4229-916e-cf2f804fd94c None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:53.115688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4867-8f0f-4229-916e-cf2f804fd94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:53.136141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-06ee4867-8f0f-4229-916e-cf2f804fd94c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:53.137649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-06ee4867-8f0f-4229-916e-cf2f804fd94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:53.166497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:53.227216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27398f-2db2-4555-89ba-2d6646e65c9c None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:53.227569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27398f-2db2-4555-89ba-2d6646e65c9c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:53.227840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27398f-2db2-4555-89ba-2d6646e65c9c None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:53.230744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 194/396] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:53.235476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc269942-11f0-4061-b0b4-f7438deee3f8 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:53.235768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc269942-11f0-4061-b0b4-f7438deee3f8 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:53.236191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc269942-11f0-4061-b0b4-f7438deee3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:53.241674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 203/397] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:53.266030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4867-8f0f-4229-916e-cf2f804fd94c None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:53.272397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-cc269942-11f0-4061-b0b4-f7438deee3f8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:53.273602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-cc269942-11f0-4061-b0b4-f7438deee3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:53.363522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 195/398] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:53.406998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4867-8f0f-4229-916e-cf2f804fd94c None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:53.420775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc269942-11f0-4061-b0b4-f7438deee3f8 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:53.434672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:53.469116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb8b41-4bc2-41ef-bdcc-6af75a1186e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:53.469915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb8b41-4bc2-41ef-bdcc-6af75a1186e0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:53.470199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb8b41-4bc2-41ef-bdcc-6af75a1186e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:53.470476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb8b41-4bc2-41ef-bdcc-6af75a1186e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:53.504332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb8b41-4bc2-41ef-bdcc-6af75a1186e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ccbb8b41-4bc2-41ef-bdcc-6af75a1186e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:53.512338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:53.513219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:53.513994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:53.520339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 204/399] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:53.522727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb8b41-4bc2-41ef-bdcc-6af75a1186e0 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:53.537870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc269942-11f0-4061-b0b4-f7438deee3f8 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:53.546402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:53.609308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ae96b-b753-4b04-ac7c-351346fcb0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:53.610121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ae96b-b753-4b04-ac7c-351346fcb0ce None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:53.611629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ae96b-b753-4b04-ac7c-351346fcb0ce None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:53.612112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ae96b-b753-4b04-ac7c-351346fcb0ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:53.628248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ae96b-b753-4b04-ac7c-351346fcb0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-ec3ae96b-b753-4b04-ac7c-351346fcb0ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:53.642228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:53.643160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:53.643981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:53.650578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 196/400] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:53.656360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ae96b-b753-4b04-ac7c-351346fcb0ce None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:53.700019 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb8b41-4bc2-41ef-bdcc-6af75a1186e0 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:53.767895 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3b796-f653-467f-872f-947ea026318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:53.768568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3b796-f653-467f-872f-947ea026318f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:53.768849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3b796-f653-467f-872f-947ea026318f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:53.769125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3b796-f653-467f-872f-947ea026318f None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:53.769875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3b796-f653-467f-872f-947ea026318f None admin] RBAC: Adding query filter params (name=member) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:53.770177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3b796-f653-467f-872f-947ea026318f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:53.771579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3b796-f653-467f-872f-947ea026318f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:53.779807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:53.792813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 205/401] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:53.803896 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3b796-f653-467f-872f-947ea026318f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:53.840551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ae96b-b753-4b04-ac7c-351346fcb0ce None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:53.898662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744dae9-f685-4ddd-907f-d92a6962fdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:53.899427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744dae9-f685-4ddd-907f-d92a6962fdbc None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:53.899807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744dae9-f685-4ddd-907f-d92a6962fdbc None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:53.900176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744dae9-f685-4ddd-907f-d92a6962fdbc None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:53.901135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744dae9-f685-4ddd-907f-d92a6962fdbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:53.901640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744dae9-f685-4ddd-907f-d92a6962fdbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:53.903083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744dae9-f685-4ddd-907f-d92a6962fdbc None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:53.918941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 197/402] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:53.922171 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:53.924316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744dae9-f685-4ddd-907f-d92a6962fdbc None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:53.948209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3b796-f653-467f-872f-947ea026318f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:53.993851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c6e0b-56c9-4104-9f28-d0b53b26c600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:53.995075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c6e0b-56c9-4104-9f28-d0b53b26c600 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:53.995567 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c6e0b-56c9-4104-9f28-d0b53b26c600 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:53.996013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c6e0b-56c9-4104-9f28-d0b53b26c600 None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:53.997826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c6e0b-56c9-4104-9f28-d0b53b26c600 None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:54.000746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c6e0b-56c9-4104-9f28-d0b53b26c600 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:54.003392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 206/403] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:53 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:54.009121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c6e0b-56c9-4104-9f28-d0b53b26c600 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:54.115798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744dae9-f685-4ddd-907f-d92a6962fdbc None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:54.181998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:54.191079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657ddfc-8c2b-4797-a739-d2ebb23597c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:54.192397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657ddfc-8c2b-4797-a739-d2ebb23597c5 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:54.197004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c6e0b-56c9-4104-9f28-d0b53b26c600 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:54.197431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657ddfc-8c2b-4797-a739-d2ebb23597c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:54.197431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657ddfc-8c2b-4797-a739-d2ebb23597c5 None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:54.198169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657ddfc-8c2b-4797-a739-d2ebb23597c5 None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:54.199801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657ddfc-8c2b-4797-a739-d2ebb23597c5 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:54.203147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 198/404] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:53 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:54.208744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657ddfc-8c2b-4797-a739-d2ebb23597c5 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:54.260438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fecfd8-2a2d-47ba-b0ed-ea21e2655887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:54.261317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fecfd8-2a2d-47ba-b0ed-ea21e2655887 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:54.261601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fecfd8-2a2d-47ba-b0ed-ea21e2655887 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:54.261884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fecfd8-2a2d-47ba-b0ed-ea21e2655887 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:54.263760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fecfd8-2a2d-47ba-b0ed-ea21e2655887 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:54.265370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fecfd8-2a2d-47ba-b0ed-ea21e2655887 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:54.267092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 207/405] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:54 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:54.273938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fecfd8-2a2d-47ba-b0ed-ea21e2655887 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:54.304719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:54.413450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657ddfc-8c2b-4797-a739-d2ebb23597c5 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:54.462977 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d24bb-46e2-4dfa-902f-ac52f163dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:54.464145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d24bb-46e2-4dfa-902f-ac52f163dbda None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:54.464591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d24bb-46e2-4dfa-902f-ac52f163dbda None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:54.465007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d24bb-46e2-4dfa-902f-ac52f163dbda None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:54.466583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d24bb-46e2-4dfa-902f-ac52f163dbda None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:54.468540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d24bb-46e2-4dfa-902f-ac52f163dbda None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:54.470822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 199/406] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:54 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:54.475444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fecfd8-2a2d-47ba-b0ed-ea21e2655887 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:54.482214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d24bb-46e2-4dfa-902f-ac52f163dbda None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:54.549785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1a6b9-6d21-4902-a34f-669369994385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:54.551825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1a6b9-6d21-4902-a34f-669369994385 None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:54.553020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1a6b9-6d21-4902-a34f-669369994385 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:54.553616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1a6b9-6d21-4902-a34f-669369994385 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/groups/a60d9cb1eb494e5abd8f1ee92ceace43/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:54.557828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1a6b9-6d21-4902-a34f-669369994385 None admin] RBAC: Authorizing `identity:create_grant(project_id=33b93c71e8a648a9bd47aac2f8dbacdf, group_id=a60d9cb1eb494e5abd8f1ee92ceace43, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:54.564992 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1a6b9-6d21-4902-a34f-669369994385 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:54.578670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:54.619132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d24bb-46e2-4dfa-902f-ac52f163dbda None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:54.656691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 208/407] 10.222.0.78 () {58 vars in 1442 bytes} [Fri Jun 17 08:32:54 2022] PUT /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/groups/a60d9cb1eb494e5abd8f1ee92ceace43/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:54.658950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c451-7e42-4e21-af2a-4e296823f1e9 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:54.660981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c451-7e42-4e21-af2a-4e296823f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:54.660981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c451-7e42-4e21-af2a-4e296823f1e9 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:54.662567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795f9d2-aad7-48be-a8a6-bf018a64774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:54.663739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795f9d2-aad7-48be-a8a6-bf018a64774f None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:54.664155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795f9d2-aad7-48be-a8a6-bf018a64774f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:54.664555 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795f9d2-aad7-48be-a8a6-bf018a64774f None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/groups/a60d9cb1eb494e5abd8f1ee92ceace43/roles/3ef6518e7cfb491dab86c245c0aeac21` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:54.666607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 209/408] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:54.667740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795f9d2-aad7-48be-a8a6-bf018a64774f None admin] RBAC: Authorizing `identity:create_grant(project_id=33b93c71e8a648a9bd47aac2f8dbacdf, group_id=a60d9cb1eb494e5abd8f1ee92ceace43, role_id=3ef6518e7cfb491dab86c245c0aeac21)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:54.668355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b7a66-e35b-42e2-9e96-f62e3cab5896 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:54.668746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b7a66-e35b-42e2-9e96-f62e3cab5896 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:54.669127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b7a66-e35b-42e2-9e96-f62e3cab5896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:54.669859 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795f9d2-aad7-48be-a8a6-bf018a64774f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:54.689550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3a5b7a66-e35b-42e2-9e96-f62e3cab5896 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:54.690908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3a5b7a66-e35b-42e2-9e96-f62e3cab5896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:54.755688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 200/409] 10.222.0.78 () {58 vars in 1442 bytes} [Fri Jun 17 08:32:54 2022] PUT /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf/groups/a60d9cb1eb494e5abd8f1ee92ceace43/roles/3ef6518e7cfb491dab86c245c0aeac21 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:54.776335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 210/410] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:54.799289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795f9d2-aad7-48be-a8a6-bf018a64774f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:54.938275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795f9d2-aad7-48be-a8a6-bf018a64774f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:54.971747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:54.977762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158d1a-1c2a-4066-8ff1-8b9524ffcfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:54.978585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158d1a-1c2a-4066-8ff1-8b9524ffcfa4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:54.978871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158d1a-1c2a-4066-8ff1-8b9524ffcfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:54.979154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158d1a-1c2a-4066-8ff1-8b9524ffcfa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:54.993758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87158d1a-1c2a-4066-8ff1-8b9524ffcfa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-87158d1a-1c2a-4066-8ff1-8b9524ffcfa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:55.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:55.003723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:55.004820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 201/411] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:32:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:55.010577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b7a66-e35b-42e2-9e96-f62e3cab5896 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:55.014057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:55.094247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74387ec-355f-4f1b-a40d-9d57914c0daf None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:55.094620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74387ec-355f-4f1b-a40d-9d57914c0daf None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:55.094975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74387ec-355f-4f1b-a40d-9d57914c0daf None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:55.096725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 202/412] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:55.102074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c206f8-bdc6-46ed-974e-8a018bd69bbd None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:55.102428 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c206f8-bdc6-46ed-974e-8a018bd69bbd None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:55.102779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c206f8-bdc6-46ed-974e-8a018bd69bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:55.120326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-e0c206f8-bdc6-46ed-974e-8a018bd69bbd None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:55.121609 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e0c206f8-bdc6-46ed-974e-8a018bd69bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:55.138234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b7a66-e35b-42e2-9e96-f62e3cab5896 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:55.178734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc171-3776-417f-97f1-12cbd2f302bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:55.179545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc171-3776-417f-97f1-12cbd2f302bc None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:55.179885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc171-3776-417f-97f1-12cbd2f302bc None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:55.180237 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc171-3776-417f-97f1-12cbd2f302bc None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:55.181214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bc171-3776-417f-97f1-12cbd2f302bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:55.181595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bc171-3776-417f-97f1-12cbd2f302bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:55.183153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bc171-3776-417f-97f1-12cbd2f302bc None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:55.193939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 211/413] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:55.198776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc171-3776-417f-97f1-12cbd2f302bc None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:55.206887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 203/414] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:55.243526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c206f8-bdc6-46ed-974e-8a018bd69bbd None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:55.314424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:55.374205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc171-3776-417f-97f1-12cbd2f302bc None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:55.417592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c206f8-bdc6-46ed-974e-8a018bd69bbd None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:55.434820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234f2db-42af-4cb3-b337-f14cbda115fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:55.435765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234f2db-42af-4cb3-b337-f14cbda115fb None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:55.436074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234f2db-42af-4cb3-b337-f14cbda115fb None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:55.436391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234f2db-42af-4cb3-b337-f14cbda115fb None admin] PATH_INFO: `/v3/groups/f41b5a86f7264cd6b540ad620d2693c0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:55.439060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234f2db-42af-4cb3-b337-f14cbda115fb None admin] RBAC: Authorizing `identity:get_group(group_id=f41b5a86f7264cd6b540ad620d2693c0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:55.440568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234f2db-42af-4cb3-b337-f14cbda115fb None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:55.448738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 212/415] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:55 2022] GET /identity/v3/groups/f41b5a86f7264cd6b540ad620d2693c0 => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:55.449586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234f2db-42af-4cb3-b337-f14cbda115fb None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:55.463753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:55.499763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280091b3-5bc4-4d59-803b-98306e9ec345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:55.500578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280091b3-5bc4-4d59-803b-98306e9ec345 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:55.500862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280091b3-5bc4-4d59-803b-98306e9ec345 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:55.501226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280091b3-5bc4-4d59-803b-98306e9ec345 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:55.518295 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280091b3-5bc4-4d59-803b-98306e9ec345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-280091b3-5bc4-4d59-803b-98306e9ec345 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:55.526141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:55.527068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:55.527902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:55.532757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 204/416] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:55.533687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280091b3-5bc4-4d59-803b-98306e9ec345 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:55.658991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234f2db-42af-4cb3-b337-f14cbda115fb None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:55.689221 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280091b3-5bc4-4d59-803b-98306e9ec345 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:55.707574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b0655-bf5c-4b83-9e67-8ee945be7a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:55.708717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b0655-bf5c-4b83-9e67-8ee945be7a57 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:55.709498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b0655-bf5c-4b83-9e67-8ee945be7a57 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:55.709786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b0655-bf5c-4b83-9e67-8ee945be7a57 None admin] PATH_INFO: `/v3/projects/9bb6ac161b2c421f94fa26d18ee99634` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:55.710997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b0655-bf5c-4b83-9e67-8ee945be7a57 None admin] RBAC: Authorizing `identity:get_project(project_id=9bb6ac161b2c421f94fa26d18ee99634)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:55.713058 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b0655-bf5c-4b83-9e67-8ee945be7a57 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:55.716090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 213/417] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:55 2022] GET /identity/v3/projects/9bb6ac161b2c421f94fa26d18ee99634 => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:55.717691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5b950-ffb2-4374-a747-c1561581f13b None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:55.718256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5b950-ffb2-4374-a747-c1561581f13b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:55.718541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5b950-ffb2-4374-a747-c1561581f13b None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:55.720603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 214/418] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:55.725577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5b950-ffb2-4374-a747-c1561581f13b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:55.729054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:55.730452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf5e76-5a3b-48fe-93d3-0b1be9b07ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:55.731313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5e76-5a3b-48fe-93d3-0b1be9b07ab9 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:55.731770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5e76-5a3b-48fe-93d3-0b1be9b07ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:55.732212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5e76-5a3b-48fe-93d3-0b1be9b07ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:55.733664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf5e76-5a3b-48fe-93d3-0b1be9b07ab9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:55.734115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf5e76-5a3b-48fe-93d3-0b1be9b07ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:55.735741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf5e76-5a3b-48fe-93d3-0b1be9b07ab9 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:55.745450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 205/419] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:55.747202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422ce0-e268-4a6b-ac1d-09300e4e1b28 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:55.747657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422ce0-e268-4a6b-ac1d-09300e4e1b28 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:55.748068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422ce0-e268-4a6b-ac1d-09300e4e1b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:55.766247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b8422ce0-e268-4a6b-ac1d-09300e4e1b28 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:55.767761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b8422ce0-e268-4a6b-ac1d-09300e4e1b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:55.804415 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:55.839243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 206/420] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:55.840450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422ce0-e268-4a6b-ac1d-09300e4e1b28 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:55.849088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5b950-ffb2-4374-a747-c1561581f13b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:55.902921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f0ac9-a169-433c-93be-74fb5244bd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:55.903841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0ac9-a169-433c-93be-74fb5244bd0c None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:55.904128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0ac9-a169-433c-93be-74fb5244bd0c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:55.904412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0ac9-a169-433c-93be-74fb5244bd0c None admin] PATH_INFO: `/v3/projects/9bb6ac161b2c421f94fa26d18ee99634/groups/f41b5a86f7264cd6b540ad620d2693c0/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:55.907319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f0ac9-a169-433c-93be-74fb5244bd0c None admin] RBAC: Authorizing `identity:create_grant(project_id=9bb6ac161b2c421f94fa26d18ee99634, group_id=f41b5a86f7264cd6b540ad620d2693c0, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:55.908800 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f0ac9-a169-433c-93be-74fb5244bd0c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:55.962590 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422ce0-e268-4a6b-ac1d-09300e4e1b28 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:55.974603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 215/421] 10.222.0.78 () {58 vars in 1442 bytes} [Fri Jun 17 08:32:55 2022] PUT /identity/v3/projects/9bb6ac161b2c421f94fa26d18ee99634/groups/f41b5a86f7264cd6b540ad620d2693c0/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:32:55.975208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f0ac9-a169-433c-93be-74fb5244bd0c None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:56.020379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5a419-91ef-4ed1-901d-3b6485bbe826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:56.021742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5a419-91ef-4ed1-901d-3b6485bbe826 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:56.022222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5a419-91ef-4ed1-901d-3b6485bbe826 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:56.022734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5a419-91ef-4ed1-901d-3b6485bbe826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:56.083076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:56.085965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:56.142507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5a419-91ef-4ed1-901d-3b6485bbe826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:56.144029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5a419-91ef-4ed1-901d-3b6485bbe826 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:56.148316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f0ac9-a169-433c-93be-74fb5244bd0c None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:56.214099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff5d42-4780-4aca-bde7-0882dc2f9928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:56.214851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5d42-4780-4aca-bde7-0882dc2f9928 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:56.215126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5d42-4780-4aca-bde7-0882dc2f9928 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:56.215456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5d42-4780-4aca-bde7-0882dc2f9928 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:56.231282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff5d42-4780-4aca-bde7-0882dc2f9928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-02ff5d42-4780-4aca-bde7-0882dc2f9928 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:56.240189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:56.241143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:56.241945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 216/422] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:56.247510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff5d42-4780-4aca-bde7-0882dc2f9928 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:56.305549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 207/423] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:56.312532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5a419-91ef-4ed1-901d-3b6485bbe826 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:56.381269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff5d42-4780-4aca-bde7-0882dc2f9928 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:56.405677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:56.418195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20114-52aa-4ab9-a1ec-0299d6f409bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:56.418964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20114-52aa-4ab9-a1ec-0299d6f409bb None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:56.419233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20114-52aa-4ab9-a1ec-0299d6f409bb None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:56.419546 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20114-52aa-4ab9-a1ec-0299d6f409bb None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:56.420319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e20114-52aa-4ab9-a1ec-0299d6f409bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:56.421346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e20114-52aa-4ab9-a1ec-0299d6f409bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:56.422786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e20114-52aa-4ab9-a1ec-0299d6f409bb None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:56.432242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 217/424] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:56.437868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20114-52aa-4ab9-a1ec-0299d6f409bb None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:56.462280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:56.546252 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5a419-91ef-4ed1-901d-3b6485bbe826 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:56.553072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20114-52aa-4ab9-a1ec-0299d6f409bb None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:56.590504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6149c42-f23e-4df4-9c73-f1579ef258fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:56.591261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6149c42-f23e-4df4-9c73-f1579ef258fe None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:56.591576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6149c42-f23e-4df4-9c73-f1579ef258fe None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:56.591853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6149c42-f23e-4df4-9c73-f1579ef258fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:56.639755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cff223-ffba-492e-b7d7-2e1a4ff454b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:56.640978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cff223-ffba-492e-b7d7-2e1a4ff454b0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:56.641483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cff223-ffba-492e-b7d7-2e1a4ff454b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:56.641952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cff223-ffba-492e-b7d7-2e1a4ff454b0 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:56.643371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cff223-ffba-492e-b7d7-2e1a4ff454b0 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:56.645033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cff223-ffba-492e-b7d7-2e1a4ff454b0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:56.647219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 208/425] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:56 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:56.648742 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:56.661298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cff223-ffba-492e-b7d7-2e1a4ff454b0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:56.666071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6149c42-f23e-4df4-9c73-f1579ef258fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:56.668084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6149c42-f23e-4df4-9c73-f1579ef258fe None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:56.778150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 218/426] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:32:56.788373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6149c42-f23e-4df4-9c73-f1579ef258fe None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:56.817608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cff223-ffba-492e-b7d7-2e1a4ff454b0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:56.894020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:56.911851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6149c42-f23e-4df4-9c73-f1579ef258fe None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:56.916657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782974f2-6ed1-4b32-8f60-e900ac411199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:56.917543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782974f2-6ed1-4b32-8f60-e900ac411199 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:56.917833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782974f2-6ed1-4b32-8f60-e900ac411199 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:56.918109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782974f2-6ed1-4b32-8f60-e900ac411199 None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:56.924147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782974f2-6ed1-4b32-8f60-e900ac411199 None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:56.925622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782974f2-6ed1-4b32-8f60-e900ac411199 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:56.927704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 209/427] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:56 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:56.933077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782974f2-6ed1-4b32-8f60-e900ac411199 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:56.950918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70939072-8576-4547-958f-a18565e75321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:56.952998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70939072-8576-4547-958f-a18565e75321 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:56.953503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:56.954332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70939072-8576-4547-958f-a18565e75321 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:56.954811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70939072-8576-4547-958f-a18565e75321 None admin] PATH_INFO: `/v3/projects/82e4708d10bd4a56b8c263303c8beb29` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:56.958406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70939072-8576-4547-958f-a18565e75321 None admin] RBAC: Authorizing `identity:get_project(project_id=82e4708d10bd4a56b8c263303c8beb29)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:56.960310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70939072-8576-4547-958f-a18565e75321 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:56.962610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 219/428] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:56 2022] GET /identity/v3/projects/82e4708d10bd4a56b8c263303c8beb29 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:56.968784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70939072-8576-4547-958f-a18565e75321 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:57.120011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782974f2-6ed1-4b32-8f60-e900ac411199 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:57.154140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70939072-8576-4547-958f-a18565e75321 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:57.187022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ac4f4-d070-468c-82ac-5f4c252eceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:57.187726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ac4f4-d070-468c-82ac-5f4c252eceff None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:57.188008 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ac4f4-d070-468c-82ac-5f4c252eceff None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:57.188282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ac4f4-d070-468c-82ac-5f4c252eceff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:57.192024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ac4f4-d070-468c-82ac-5f4c252eceff None admin] RBAC: Adding query filter params (group.id=a60d9cb1eb494e5abd8f1ee92ceace43, role.id=0b03acccb970430e8e3b5a7921cb70d0, scope.project.id=82e4708d10bd4a56b8c263303c8beb29) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:57.192417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ac4f4-d070-468c-82ac-5f4c252eceff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:57.194882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ac4f4-d070-468c-82ac-5f4c252eceff None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:57.206950 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 210/429] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Jun 17 08:32:56 2022] GET /identity/v3/role_assignments?group.id=a60d9cb1eb494e5abd8f1ee92ceace43&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 611 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:57.223196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0147930-c260-4df0-93ac-b8c84692fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:57.224105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0147930-c260-4df0-93ac-b8c84692fb6b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:57.224436 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0147930-c260-4df0-93ac-b8c84692fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:57.224719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0147930-c260-4df0-93ac-b8c84692fb6b None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:57.225907 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0147930-c260-4df0-93ac-b8c84692fb6b None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:57.227368 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0147930-c260-4df0-93ac-b8c84692fb6b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:57.229430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 220/430] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:56 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:57.236931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ac4f4-d070-468c-82ac-5f4c252eceff None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:57.337697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:57.385651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ac4f4-d070-468c-82ac-5f4c252eceff None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:57.424602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb44d-ea02-4905-8df8-5528bd46d12c None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:57.424937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb44d-ea02-4905-8df8-5528bd46d12c None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:57.425169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb44d-ea02-4905-8df8-5528bd46d12c None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:57.426648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 221/431] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:32:57.433511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1d5ca-fc5e-43f0-a447-f3b9279cf08a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:57.433799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1d5ca-fc5e-43f0-a447-f3b9279cf08a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:57.434072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1d5ca-fc5e-43f0-a447-f3b9279cf08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:57.456757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae13ad-2b6c-4c46-8acb-b69b7eb62c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:57.457444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae13ad-2b6c-4c46-8acb-b69b7eb62c0c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:57.457730 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae13ad-2b6c-4c46-8acb-b69b7eb62c0c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:57.458004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae13ad-2b6c-4c46-8acb-b69b7eb62c0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:57.458855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae13ad-2b6c-4c46-8acb-b69b7eb62c0c None admin] RBAC: Adding query filter params (group.id=a60d9cb1eb494e5abd8f1ee92ceace43, role.id=3ef6518e7cfb491dab86c245c0aeac21, scope.project.id=82e4708d10bd4a56b8c263303c8beb29) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:57.459170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae13ad-2b6c-4c46-8acb-b69b7eb62c0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:57.460675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae13ad-2b6c-4c46-8acb-b69b7eb62c0c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:57.467739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-6cb1d5ca-fc5e-43f0-a447-f3b9279cf08a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:57.469778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6cb1d5ca-fc5e-43f0-a447-f3b9279cf08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:57.480784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 211/432] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Jun 17 08:32:57 2022] GET /identity/v3/role_assignments?group.id=a60d9cb1eb494e5abd8f1ee92ceace43&scope.project.id=82e4708d10bd4a56b8c263303c8beb29&role.id=3ef6518e7cfb491dab86c245c0aeac21 => generated 611 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:57.489173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:57.558511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 222/433] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:57.585810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae13ad-2b6c-4c46-8acb-b69b7eb62c0c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:57.601980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431de036-ebfa-46b0-9730-c31059749689 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:57.602180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431de036-ebfa-46b0-9730-c31059749689 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:57.602527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431de036-ebfa-46b0-9730-c31059749689 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:57.604339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 223/434] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:57.609839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc9f8-7b8e-46b9-9ddc-d78d3753bc5b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:57.610138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc9f8-7b8e-46b9-9ddc-d78d3753bc5b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:57.610409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc9f8-7b8e-46b9-9ddc-d78d3753bc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:57.629735 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-197dc9f8-7b8e-46b9-9ddc-d78d3753bc5b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:57.631060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-197dc9f8-7b8e-46b9-9ddc-d78d3753bc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:57.718016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 224/435] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:32:57.728571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae13ad-2b6c-4c46-8acb-b69b7eb62c0c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:57.759853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc9f8-7b8e-46b9-9ddc-d78d3753bc5b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:57.768151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca90ca0-2d64-4c32-89fd-94c061393ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:57.768961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90ca0-2d64-4c32-89fd-94c061393ff1 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:57.769244 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90ca0-2d64-4c32-89fd-94c061393ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:57.769522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90ca0-2d64-4c32-89fd-94c061393ff1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:57.774383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:57.787482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca90ca0-2d64-4c32-89fd-94c061393ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-9ca90ca0-2d64-4c32-89fd-94c061393ff1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:57.798099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:57.799677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 08:32:57.800673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:32:57.803095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 212/436] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:57.810672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca90ca0-2d64-4c32-89fd-94c061393ff1 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:57.867292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:57.895600 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dc9f8-7b8e-46b9-9ddc-d78d3753bc5b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:57.953968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70a9c0-84d0-4bc3-8b23-63f18b05684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:57.955587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70a9c0-84d0-4bc3-8b23-63f18b05684d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:57.955882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70a9c0-84d0-4bc3-8b23-63f18b05684d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:57.956166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70a9c0-84d0-4bc3-8b23-63f18b05684d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:57.957512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca90ca0-2d64-4c32-89fd-94c061393ff1 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:57.970704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70a9c0-84d0-4bc3-8b23-63f18b05684d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-6b70a9c0-84d0-4bc3-8b23-63f18b05684d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:57.980127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:57.981042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:57.981834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 225/437] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:32:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:32:57.988162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70a9c0-84d0-4bc3-8b23-63f18b05684d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:58.007964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cb8a7-4c0a-4174-a779-50e1bae5c97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:58.009117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cb8a7-4c0a-4174-a779-50e1bae5c97a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.009496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cb8a7-4c0a-4174-a779-50e1bae5c97a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.009893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cb8a7-4c0a-4174-a779-50e1bae5c97a None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.010709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cb8a7-4c0a-4174-a779-50e1bae5c97a None admin] RBAC: Adding query filter params (name=member) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:58.011124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cb8a7-4c0a-4174-a779-50e1bae5c97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:58.012713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cb8a7-4c0a-4174-a779-50e1bae5c97a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:58.022853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 213/438] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:32:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:58.028094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cb8a7-4c0a-4174-a779-50e1bae5c97a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:58.101543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:58.141375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70a9c0-84d0-4bc3-8b23-63f18b05684d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:58.164209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cb8a7-4c0a-4174-a779-50e1bae5c97a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:58.188502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2060778-4747-4cae-8aca-9be2a2cd6dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:58.190006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060778-4747-4cae-8aca-9be2a2cd6dc5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.190006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060778-4747-4cae-8aca-9be2a2cd6dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.190006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060778-4747-4cae-8aca-9be2a2cd6dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.190461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2060778-4747-4cae-8aca-9be2a2cd6dc5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:58.191308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2060778-4747-4cae-8aca-9be2a2cd6dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:58.197347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2060778-4747-4cae-8aca-9be2a2cd6dc5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:58.208510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 226/439] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:32:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:58.213540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2060778-4747-4cae-8aca-9be2a2cd6dc5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:58.216565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:58.217410 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34490a-a637-4563-ad3e-1100a0fd8d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:58.217837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34490a-a637-4563-ad3e-1100a0fd8d13 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.218296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34490a-a637-4563-ad3e-1100a0fd8d13 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.218583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34490a-a637-4563-ad3e-1100a0fd8d13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.301036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34490a-a637-4563-ad3e-1100a0fd8d13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:58.302479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34490a-a637-4563-ad3e-1100a0fd8d13 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:58.337052 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2060778-4747-4cae-8aca-9be2a2cd6dc5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:58.371095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:58.375589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7244c0a-c0ee-4639-ae9a-5a08810dd71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:58.376345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7244c0a-c0ee-4639-ae9a-5a08810dd71d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.376640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7244c0a-c0ee-4639-ae9a-5a08810dd71d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.376926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7244c0a-c0ee-4639-ae9a-5a08810dd71d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.424614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 214/440] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:32:58.426038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34490a-a637-4563-ad3e-1100a0fd8d13 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:58.460507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7244c0a-c0ee-4639-ae9a-5a08810dd71d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:58.462647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7244c0a-c0ee-4639-ae9a-5a08810dd71d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:58.464038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:58.563934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34490a-a637-4563-ad3e-1100a0fd8d13 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:58.580537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 227/441] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:32:58.581847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360ccb-9c06-4393-8605-f6b74bedb2ef None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.582134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360ccb-9c06-4393-8605-f6b74bedb2ef None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.582412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360ccb-9c06-4393-8605-f6b74bedb2ef None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.583695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 228/442] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:32:58.588177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360ccb-9c06-4393-8605-f6b74bedb2ef None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:58.604510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eafe4-81fc-4de9-a71a-29eb3f2ef255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:58.605368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eafe4-81fc-4de9-a71a-29eb3f2ef255 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.605649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eafe4-81fc-4de9-a71a-29eb3f2ef255 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.605922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eafe4-81fc-4de9-a71a-29eb3f2ef255 None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.607087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355eafe4-81fc-4de9-a71a-29eb3f2ef255 None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:58.609131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355eafe4-81fc-4de9-a71a-29eb3f2ef255 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:58.610812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 215/443] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:58 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:58.611978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e15f0-ad64-467a-8abd-30b649c68ca9 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.612268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e15f0-ad64-467a-8abd-30b649c68ca9 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.612532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e15f0-ad64-467a-8abd-30b649c68ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.628385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-991e15f0-ad64-467a-8abd-30b649c68ca9 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:32:58.629571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-991e15f0-ad64-467a-8abd-30b649c68ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:32:58.646602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:58.689170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360ccb-9c06-4393-8605-f6b74bedb2ef None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:58.691154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:58.699062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 216/444] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:32:58.699946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e15f0-ad64-467a-8abd-30b649c68ca9 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:58.733561 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde57d6-ff08-43e2-ae9b-cadb103951ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:58.734419 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde57d6-ff08-43e2-ae9b-cadb103951ec None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.734702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde57d6-ff08-43e2-ae9b-cadb103951ec None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.734978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde57d6-ff08-43e2-ae9b-cadb103951ec None admin] PATH_INFO: `/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.736180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde57d6-ff08-43e2-ae9b-cadb103951ec None admin] RBAC: Authorizing `identity:get_project(project_id=33b93c71e8a648a9bd47aac2f8dbacdf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:58.737612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde57d6-ff08-43e2-ae9b-cadb103951ec None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:58.739297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 229/445] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:58 2022] GET /identity/v3/projects/33b93c71e8a648a9bd47aac2f8dbacdf => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:58.740147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde57d6-ff08-43e2-ae9b-cadb103951ec None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:58.802855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e15f0-ad64-467a-8abd-30b649c68ca9 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:58.836885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c75cda-694e-438b-b1a0-e9ce61f04249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:58.837676 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75cda-694e-438b-b1a0-e9ce61f04249 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.837983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75cda-694e-438b-b1a0-e9ce61f04249 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.838256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75cda-694e-438b-b1a0-e9ce61f04249 None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.838813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde57d6-ff08-43e2-ae9b-cadb103951ec None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:58.839463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c75cda-694e-438b-b1a0-e9ce61f04249 None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:58.840924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c75cda-694e-438b-b1a0-e9ce61f04249 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:58.843140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 217/446] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:58 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:58.844028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c75cda-694e-438b-b1a0-e9ce61f04249 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:58.869356 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:58.873219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1efbd-ad6e-4bda-ad69-c0673b6b6cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:58.874044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1efbd-ad6e-4bda-ad69-c0673b6b6cc3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.874323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1efbd-ad6e-4bda-ad69-c0673b6b6cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.874599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1efbd-ad6e-4bda-ad69-c0673b6b6cc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.884848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1efbd-ad6e-4bda-ad69-c0673b6b6cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-29f1efbd-ad6e-4bda-ad69-c0673b6b6cc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:32:58.893091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:32:58.894212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 230/447] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:32:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:32:58.895186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1efbd-ad6e-4bda-ad69-c0673b6b6cc3 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:58.926127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:58.957664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c75cda-694e-438b-b1a0-e9ce61f04249 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:58.991270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0ed0b-839c-4ffa-baed-3070e94432e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:58.992226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0ed0b-839c-4ffa-baed-3070e94432e4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:58.992416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0ed0b-839c-4ffa-baed-3070e94432e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:58.992688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0ed0b-839c-4ffa-baed-3070e94432e4 None admin] PATH_INFO: `/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:58.993838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0ed0b-839c-4ffa-baed-3070e94432e4 None admin] RBAC: Authorizing `identity:get_group(group_id=a60d9cb1eb494e5abd8f1ee92ceace43)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:58.995303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0ed0b-839c-4ffa-baed-3070e94432e4 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:58.996942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 218/448] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:58 2022] GET /identity/v3/groups/a60d9cb1eb494e5abd8f1ee92ceace43 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:58.997684 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0ed0b-839c-4ffa-baed-3070e94432e4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:58.998326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1efbd-ad6e-4bda-ad69-c0673b6b6cc3 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:59.035334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17036ab4-ffd8-450e-87c0-5f6fa06ad41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:59.036004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036ab4-ffd8-450e-87c0-5f6fa06ad41e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:59.036292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036ab4-ffd8-450e-87c0-5f6fa06ad41e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:59.036570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036ab4-ffd8-450e-87c0-5f6fa06ad41e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:59.037408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17036ab4-ffd8-450e-87c0-5f6fa06ad41e None admin] RBAC: Adding query filter params (group.id=a60d9cb1eb494e5abd8f1ee92ceace43, role.id=0b03acccb970430e8e3b5a7921cb70d0, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:59.037722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17036ab4-ffd8-450e-87c0-5f6fa06ad41e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:59.039157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17036ab4-ffd8-450e-87c0-5f6fa06ad41e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:59.045044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 231/449] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Jun 17 08:32:58 2022] GET /identity/v3/role_assignments?group.id=a60d9cb1eb494e5abd8f1ee92ceace43&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=0b03acccb970430e8e3b5a7921cb70d0 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:59.046337 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17036ab4-ffd8-450e-87c0-5f6fa06ad41e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:59.115194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:59.126055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0ed0b-839c-4ffa-baed-3070e94432e4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:59.163143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:59.164423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cab75-8cf1-4730-914e-9a950f93c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:59.165113 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cab75-8cf1-4730-914e-9a950f93c94f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:59.165398 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cab75-8cf1-4730-914e-9a950f93c94f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:59.165675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cab75-8cf1-4730-914e-9a950f93c94f None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:59.166437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cab75-8cf1-4730-914e-9a950f93c94f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:59.166750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cab75-8cf1-4730-914e-9a950f93c94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:59.168209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cab75-8cf1-4730-914e-9a950f93c94f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:59.173200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17036ab4-ffd8-450e-87c0-5f6fa06ad41e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:59.179421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 219/450] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:32:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:59.185187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cab75-8cf1-4730-914e-9a950f93c94f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:59.213517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0ef95-70a7-4062-aeb3-6b21daf6fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:59.214184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ef95-70a7-4062-aeb3-6b21daf6fe2b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:59.214473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ef95-70a7-4062-aeb3-6b21daf6fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:59.214756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ef95-70a7-4062-aeb3-6b21daf6fe2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:59.215620 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0ef95-70a7-4062-aeb3-6b21daf6fe2b None admin] RBAC: Adding query filter params (group.id=a60d9cb1eb494e5abd8f1ee92ceace43, role.id=3ef6518e7cfb491dab86c245c0aeac21, scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:32:59.215946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0ef95-70a7-4062-aeb3-6b21daf6fe2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:59.217439 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0ef95-70a7-4062-aeb3-6b21daf6fe2b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:59.225138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 232/451] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Jun 17 08:32:59 2022] GET /identity/v3/role_assignments?group.id=a60d9cb1eb494e5abd8f1ee92ceace43&scope.project.id=33b93c71e8a648a9bd47aac2f8dbacdf&role.id=3ef6518e7cfb491dab86c245c0aeac21 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:59.307200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cab75-8cf1-4730-914e-9a950f93c94f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:59.364931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201be72-026e-4d85-b6df-a06697b7499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:59.366076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201be72-026e-4d85-b6df-a06697b7499f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:59.366482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201be72-026e-4d85-b6df-a06697b7499f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:59.366953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201be72-026e-4d85-b6df-a06697b7499f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:59.398477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:59.454897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201be72-026e-4d85-b6df-a06697b7499f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:59.456452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201be72-026e-4d85-b6df-a06697b7499f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:59.572162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 220/452] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:32:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:32:59.578933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0ef95-70a7-4062-aeb3-6b21daf6fe2b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:59.687447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0ef95-70a7-4062-aeb3-6b21daf6fe2b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:59.720641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6959f07-addc-40c3-825a-78a70e67cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:59.721492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6959f07-addc-40c3-825a-78a70e67cc1e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:59.721773 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6959f07-addc-40c3-825a-78a70e67cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:59.722048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6959f07-addc-40c3-825a-78a70e67cc1e None admin] PATH_INFO: `/v3/projects/9bb6ac161b2c421f94fa26d18ee99634` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:59.723208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6959f07-addc-40c3-825a-78a70e67cc1e None admin] RBAC: Authorizing `identity:get_project(project_id=9bb6ac161b2c421f94fa26d18ee99634)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:59.724687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6959f07-addc-40c3-825a-78a70e67cc1e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:59.726379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 233/453] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:32:59 2022] GET /identity/v3/projects/9bb6ac161b2c421f94fa26d18ee99634 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:32:59.731946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201be72-026e-4d85-b6df-a06697b7499f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:59.784396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:59.830829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201be72-026e-4d85-b6df-a06697b7499f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:32:59.863966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127603e-ead6-4174-9ca7-74b0e8d6db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:32:59.864813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127603e-ead6-4174-9ca7-74b0e8d6db07 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:32:59.865099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127603e-ead6-4174-9ca7-74b0e8d6db07 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:32:59.865380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127603e-ead6-4174-9ca7-74b0e8d6db07 None admin] PATH_INFO: `/v3/groups/f41b5a86f7264cd6b540ad620d2693c0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:32:59.866537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127603e-ead6-4174-9ca7-74b0e8d6db07 None admin] RBAC: Authorizing `identity:get_group(group_id=f41b5a86f7264cd6b540ad620d2693c0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:32:59.868018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127603e-ead6-4174-9ca7-74b0e8d6db07 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:32:59.869628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 221/454] 10.222.0.78 () {56 vars in 1180 bytes} [Fri Jun 17 08:32:59 2022] GET /identity/v3/groups/f41b5a86f7264cd6b540ad620d2693c0 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:32:59.875778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6959f07-addc-40c3-825a-78a70e67cc1e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:32:59.902960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:32:59.973150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6959f07-addc-40c3-825a-78a70e67cc1e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:00.006857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5316f-9b2d-478b-9cf0-87d2211b56c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:00.007525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5316f-9b2d-478b-9cf0-87d2211b56c5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:00.007815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5316f-9b2d-478b-9cf0-87d2211b56c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:00.008094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5316f-9b2d-478b-9cf0-87d2211b56c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:00.008920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5316f-9b2d-478b-9cf0-87d2211b56c5 None admin] RBAC: Adding query filter params (group.id=f41b5a86f7264cd6b540ad620d2693c0, role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=9bb6ac161b2c421f94fa26d18ee99634) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:00.009232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5316f-9b2d-478b-9cf0-87d2211b56c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:00.010669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5316f-9b2d-478b-9cf0-87d2211b56c5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:00.017109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 234/455] 10.222.0.78 () {56 vars in 1376 bytes} [Fri Jun 17 08:32:59 2022] GET /identity/v3/role_assignments?group.id=f41b5a86f7264cd6b540ad620d2693c0&scope.project.id=9bb6ac161b2c421f94fa26d18ee99634&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:03.160392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e424fb-238f-4c48-aa1c-4cba3d03d0a8 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:03.161181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e424fb-238f-4c48-aa1c-4cba3d03d0a8 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:03.161352 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e424fb-238f-4c48-aa1c-4cba3d03d0a8 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:03.163807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 222/456] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:03.170830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa4ae9-8bbb-4db1-a3df-4002d6736509 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:03.172198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa4ae9-8bbb-4db1-a3df-4002d6736509 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:03.172967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa4ae9-8bbb-4db1-a3df-4002d6736509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:03.212983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-eaaa4ae9-8bbb-4db1-a3df-4002d6736509 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:03.215442 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-eaaa4ae9-8bbb-4db1-a3df-4002d6736509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:03.361531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 235/457] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:33:03.410641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e424fb-238f-4c48-aa1c-4cba3d03d0a8 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:03.568040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e424fb-238f-4c48-aa1c-4cba3d03d0a8 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:03.585296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e659-f860-4d5b-a813-d3d76f7fb2fc None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:03.585917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e659-f860-4d5b-a813-d3d76f7fb2fc None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:03.586396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e659-f860-4d5b-a813-d3d76f7fb2fc None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:03.588224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 236/458] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:33:03.589483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355f931-5323-43d4-8448-45411aba29cb None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:03.589964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355f931-5323-43d4-8448-45411aba29cb None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:03.590434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355f931-5323-43d4-8448-45411aba29cb None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:03.595155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:03.596204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 237/459] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:03.597620 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648570d-29bc-4fe3-91f7-dd05a39feca8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:03.598109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648570d-29bc-4fe3-91f7-dd05a39feca8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:03.598594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648570d-29bc-4fe3-91f7-dd05a39feca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:03.609659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4db7-afc2-4eaf-a965-8c3855393249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:03.610693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4db7-afc2-4eaf-a965-8c3855393249 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:03.611131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4db7-afc2-4eaf-a965-8c3855393249 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:03.614186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4db7-afc2-4eaf-a965-8c3855393249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:03.616000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-2648570d-29bc-4fe3-91f7-dd05a39feca8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:03.617395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2648570d-29bc-4fe3-91f7-dd05a39feca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:03.622291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d4db7-afc2-4eaf-a965-8c3855393249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:03.624310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d4db7-afc2-4eaf-a965-8c3855393249 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:03.639934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-903d4db7-afc2-4eaf-a965-8c3855393249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:03.642365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:03.643214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:03.644140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:03.644140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:03.644140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:03.644140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:03.648391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 223/460] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:03.650420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671ee7-3c7b-4094-89d8-b093f41758d7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:03.650708 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671ee7-3c7b-4094-89d8-b093f41758d7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:03.650981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671ee7-3c7b-4094-89d8-b093f41758d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:03.668674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-e7671ee7-3c7b-4094-89d8-b093f41758d7 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:03.669775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e7671ee7-3c7b-4094-89d8-b093f41758d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:03.703381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 238/461] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:03.703381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648570d-29bc-4fe3-91f7-dd05a39feca8 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:03.759234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 224/462] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:03.760745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671ee7-3c7b-4094-89d8-b093f41758d7 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:03.814508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648570d-29bc-4fe3-91f7-dd05a39feca8 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:03.856725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890f20c-323f-4edd-a6fb-152fc37c5962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:03.857725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890f20c-323f-4edd-a6fb-152fc37c5962 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:03.858891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890f20c-323f-4edd-a6fb-152fc37c5962 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:03.859508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890f20c-323f-4edd-a6fb-152fc37c5962 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:03.860414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890f20c-323f-4edd-a6fb-152fc37c5962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:03.860868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890f20c-323f-4edd-a6fb-152fc37c5962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:03.862453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890f20c-323f-4edd-a6fb-152fc37c5962 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:03.881494 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 239/463] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:03.882629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890f20c-323f-4edd-a6fb-152fc37c5962 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:03.893332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671ee7-3c7b-4094-89d8-b093f41758d7 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:03.895623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:03.902717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:03.930992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fa26e-69c8-400d-ab02-cb1be35b7512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:03.931740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fa26e-69c8-400d-ab02-cb1be35b7512 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:03.932026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fa26e-69c8-400d-ab02-cb1be35b7512 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:03.932304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fa26e-69c8-400d-ab02-cb1be35b7512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:03.943499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fa26e-69c8-400d-ab02-cb1be35b7512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:03.944968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fa26e-69c8-400d-ab02-cb1be35b7512 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-f53fa26e-69c8-400d-ab02-cb1be35b7512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:03.963460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:03.964320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:03.965158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:03.965158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:03.965158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:03.965158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:03.965158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 225/464] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:03.965429 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fa26e-69c8-400d-ab02-cb1be35b7512 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:04.000315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890f20c-323f-4edd-a6fb-152fc37c5962 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:04.034223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bf81a-8dc4-46cf-bc81-eb5ad929f103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:04.035114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bf81a-8dc4-46cf-bc81-eb5ad929f103 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.035494 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bf81a-8dc4-46cf-bc81-eb5ad929f103 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.035778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bf81a-8dc4-46cf-bc81-eb5ad929f103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.046676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bf81a-8dc4-46cf-bc81-eb5ad929f103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:04.048172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bf81a-8dc4-46cf-bc81-eb5ad929f103 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-715bf81a-8dc4-46cf-bc81-eb5ad929f103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:04.066758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:04.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:04.068784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:04.068784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:04.068784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:04.068784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:04.068784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 240/465] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:04.069443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9229e-175a-4657-9521-d277566e9187 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.069623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9229e-175a-4657-9521-d277566e9187 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.069866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9229e-175a-4657-9521-d277566e9187 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.071271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 241/466] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:04.071815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9229e-175a-4657-9521-d277566e9187 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:04.081978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fa26e-69c8-400d-ab02-cb1be35b7512 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:04.119491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680faac-2539-4ee2-b976-02d4d687f47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:04.120260 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680faac-2539-4ee2-b976-02d4d687f47b None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.120553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680faac-2539-4ee2-b976-02d4d687f47b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.120868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680faac-2539-4ee2-b976-02d4d687f47b None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.121652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680faac-2539-4ee2-b976-02d4d687f47b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:04.123086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680faac-2539-4ee2-b976-02d4d687f47b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:04.140486 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:04.178657 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9229e-175a-4657-9521-d277566e9187 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:04.209103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 226/467] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:33:03 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:04.210499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680faac-2539-4ee2-b976-02d4d687f47b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:04.221209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea2cc3-09fb-46c7-ad7c-6fa760eda60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:04.221927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2cc3-09fb-46c7-ad7c-6fa760eda60b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.222210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2cc3-09fb-46c7-ad7c-6fa760eda60b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.222489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2cc3-09fb-46c7-ad7c-6fa760eda60b None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.223231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea2cc3-09fb-46c7-ad7c-6fa760eda60b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:04.223704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea2cc3-09fb-46c7-ad7c-6fa760eda60b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:04.225149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea2cc3-09fb-46c7-ad7c-6fa760eda60b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:04.232489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:04.244492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 242/468] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:04.245827 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f4fd-36a2-4668-87be-650ea8cedcb9 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.246116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f4fd-36a2-4668-87be-650ea8cedcb9 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.247182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3f4fd-36a2-4668-87be-650ea8cedcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.270547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-6fd3f4fd-36a2-4668-87be-650ea8cedcb9 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:04.272352 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6fd3f4fd-36a2-4668-87be-650ea8cedcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:04.345175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680faac-2539-4ee2-b976-02d4d687f47b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:04.367188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 243/469] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:04.372318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3f4fd-36a2-4668-87be-650ea8cedcb9 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:04.393082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645d787-a378-4fc0-b808-5286786e1634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:04.394207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645d787-a378-4fc0-b808-5286786e1634 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.394808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645d787-a378-4fc0-b808-5286786e1634 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.395573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645d787-a378-4fc0-b808-5286786e1634 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.404328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645d787-a378-4fc0-b808-5286786e1634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:04.404328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645d787-a378-4fc0-b808-5286786e1634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:04.404328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645d787-a378-4fc0-b808-5286786e1634 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:04.415126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 227/470] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:04.416029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645d787-a378-4fc0-b808-5286786e1634 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:04.438079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:04.510522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3f4fd-36a2-4668-87be-650ea8cedcb9 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:04.526366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:04.550000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375ea0f-766b-4efd-ba7e-0679065144ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:04.551012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375ea0f-766b-4efd-ba7e-0679065144ea None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.551517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375ea0f-766b-4efd-ba7e-0679065144ea None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.551988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375ea0f-766b-4efd-ba7e-0679065144ea None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.552442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645d787-a378-4fc0-b808-5286786e1634 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:04.553139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375ea0f-766b-4efd-ba7e-0679065144ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:04.554821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375ea0f-766b-4efd-ba7e-0679065144ea None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:04.589808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51df8a-3ba4-49be-b62c-bc1639533a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:04.590607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51df8a-3ba4-49be-b62c-bc1639533a07 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.590891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51df8a-3ba4-49be-b62c-bc1639533a07 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.591168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51df8a-3ba4-49be-b62c-bc1639533a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.601379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51df8a-3ba4-49be-b62c-bc1639533a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:04.602825 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51df8a-3ba4-49be-b62c-bc1639533a07 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-6a51df8a-3ba4-49be-b62c-bc1639533a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:04.620150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:04.621155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:04.627681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:04.627681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:04.627681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:04.627681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:04.627681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 228/471] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:04.627681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51df8a-3ba4-49be-b62c-bc1639533a07 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:04.631559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 244/472] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:33:04 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:04.637208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc352b7-a640-4727-9f2b-b02831470eef None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.637208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc352b7-a640-4727-9f2b-b02831470eef None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.637208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc352b7-a640-4727-9f2b-b02831470eef None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.637208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 245/473] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:04.637208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc352b7-a640-4727-9f2b-b02831470eef None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:04.773498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51df8a-3ba4-49be-b62c-bc1639533a07 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:04.780413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc352b7-a640-4727-9f2b-b02831470eef None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:04.791906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:04.811004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:04.827240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc8598-8427-48a8-98f5-bbcf4fae384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:04.828135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc8598-8427-48a8-98f5-bbcf4fae384d None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.828377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6bcdc-1475-417c-b35b-3d2b1e2fccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:04.828499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc8598-8427-48a8-98f5-bbcf4fae384d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.828688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc8598-8427-48a8-98f5-bbcf4fae384d None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.829035 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6bcdc-1475-417c-b35b-3d2b1e2fccbd None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.829485 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6bcdc-1475-417c-b35b-3d2b1e2fccbd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.829583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc8598-8427-48a8-98f5-bbcf4fae384d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:04.829665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6bcdc-1475-417c-b35b-3d2b1e2fccbd None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.830362 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6bcdc-1475-417c-b35b-3d2b1e2fccbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:04.830661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6bcdc-1475-417c-b35b-3d2b1e2fccbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:04.830809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc8598-8427-48a8-98f5-bbcf4fae384d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:04.832101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6bcdc-1475-417c-b35b-3d2b1e2fccbd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:04.847222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 246/474] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:04.849280 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464628-f215-4e90-8e1d-1f27ccde7578 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:04.849760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464628-f215-4e90-8e1d-1f27ccde7578 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:04.850232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464628-f215-4e90-8e1d-1f27ccde7578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:04.868666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-49464628-f215-4e90-8e1d-1f27ccde7578 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:04.869880 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-49464628-f215-4e90-8e1d-1f27ccde7578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:04.933724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 229/475] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:33:04 2022] POST /identity/v3/users => generated 246 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:04.934755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc8598-8427-48a8-98f5-bbcf4fae384d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:04.969084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 247/476] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:05.008753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49464628-f215-4e90-8e1d-1f27ccde7578 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:05.115783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc8598-8427-48a8-98f5-bbcf4fae384d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:05.176709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c067a-9282-4447-947a-29ffeaf9169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:05.176709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c067a-9282-4447-947a-29ffeaf9169c None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:05.176709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c067a-9282-4447-947a-29ffeaf9169c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:05.177072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c067a-9282-4447-947a-29ffeaf9169c None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:05.177588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c067a-9282-4447-947a-29ffeaf9169c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:05.179217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c067a-9282-4447-947a-29ffeaf9169c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:05.190423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49464628-f215-4e90-8e1d-1f27ccde7578 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:05.199186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:05.231713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c82a9-6bdd-4725-bb6c-6900929d7331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:05.232378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c82a9-6bdd-4725-bb6c-6900929d7331 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:05.232906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c82a9-6bdd-4725-bb6c-6900929d7331 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:05.233195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c82a9-6bdd-4725-bb6c-6900929d7331 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:05.233933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c82a9-6bdd-4725-bb6c-6900929d7331 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:05.235319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c82a9-6bdd-4725-bb6c-6900929d7331 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:05.263426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 230/477] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:33:04 2022] POST /identity/v3/users => generated 249 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:05.277032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.sql.core [None req-9f9c82a9-6bdd-4725-bb6c-6900929d7331 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 08:33:05.277032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 08:33:05.277032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [parameters: {'id': '36c2ec9ef9b54039a8e9430786099808', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 08:33:05.277032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87051) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-9f9c82a9-6bdd-4725-bb6c-6900929d7331 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application result.read() Jun 17 08:33:05.296202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return ref.to_dict() Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:33:05.297120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application yield resource Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise self.value Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application session.commit() Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 08:33:05.297999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self.session.flush() Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application compat.raise_( Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 08:33:05.298838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:33:05.299788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application result.read() Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:33:05.300603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [parameters: {'id': '36c2ec9ef9b54039a8e9430786099808', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:05.303545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 08:33:05.305450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:05.307401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 248/478] 10.222.0.78 () {60 vars in 1131 bytes} [Fri Jun 17 08:33:05 2022] POST /identity/v3/roles => generated 144 bytes in 289 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:05.309435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c067a-9282-4447-947a-29ffeaf9169c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:05.351337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:05.430440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c067a-9282-4447-947a-29ffeaf9169c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:05.493144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135bb91-b9c4-4cac-a2c3-54c4e04bd978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:05.494108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135bb91-b9c4-4cac-a2c3-54c4e04bd978 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:05.494390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135bb91-b9c4-4cac-a2c3-54c4e04bd978 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:05.494667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135bb91-b9c4-4cac-a2c3-54c4e04bd978 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:05.506556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135bb91-b9c4-4cac-a2c3-54c4e04bd978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-4135bb91-b9c4-4cac-a2c3-54c4e04bd978 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:05.516056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:05.516967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:05.517750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 231/479] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:33:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:05.522940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c82a9-6bdd-4725-bb6c-6900929d7331 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:05.637203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c82a9-6bdd-4725-bb6c-6900929d7331 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:05.672453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d91419-caae-4e35-8af9-2ce4638378ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:05.673127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d91419-caae-4e35-8af9-2ce4638378ff None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:05.673409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d91419-caae-4e35-8af9-2ce4638378ff None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:05.673684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d91419-caae-4e35-8af9-2ce4638378ff None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:05.674434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d91419-caae-4e35-8af9-2ce4638378ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:05.674737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d91419-caae-4e35-8af9-2ce4638378ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:05.676137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d91419-caae-4e35-8af9-2ce4638378ff None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:05.691583 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 249/480] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:06.797687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92748d9-2988-439d-ad0c-bebb5c271bc5 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:06.798188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92748d9-2988-439d-ad0c-bebb5c271bc5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:06.798266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92748d9-2988-439d-ad0c-bebb5c271bc5 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:06.799624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 232/481] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:06.819378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53e94-102d-44b2-bd1e-ea11c04133b9 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:06.819378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53e94-102d-44b2-bd1e-ea11c04133b9 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:06.819378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53e94-102d-44b2-bd1e-ea11c04133b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:06.848373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-9fe53e94-102d-44b2-bd1e-ea11c04133b9 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:06.849569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9fe53e94-102d-44b2-bd1e-ea11c04133b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:06.868197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:06.949655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 250/482] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:06.999635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92748d9-2988-439d-ad0c-bebb5c271bc5 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:07.185930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410d5a-e1a6-47bf-92ca-7144151df3a1 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:07.186444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410d5a-e1a6-47bf-92ca-7144151df3a1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:07.186725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410d5a-e1a6-47bf-92ca-7144151df3a1 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:07.191451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 251/483] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:07.197609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac5715-b14e-4f54-8194-6e672007c54f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:07.198178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac5715-b14e-4f54-8194-6e672007c54f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:07.198650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac5715-b14e-4f54-8194-6e672007c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:07.200648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:07.218486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92748d9-2988-439d-ad0c-bebb5c271bc5 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:07.227985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-09ac5715-b14e-4f54-8194-6e672007c54f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:07.229710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-09ac5715-b14e-4f54-8194-6e672007c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:07.295419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b2d5e-d04e-4ab6-a967-d595c2b28dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:07.296620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2d5e-d04e-4ab6-a967-d595c2b28dfe None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:07.296914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2d5e-d04e-4ab6-a967-d595c2b28dfe None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:07.297196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b2d5e-d04e-4ab6-a967-d595c2b28dfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:07.317749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b2d5e-d04e-4ab6-a967-d595c2b28dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-ef5b2d5e-d04e-4ab6-a967-d595c2b28dfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:07.335289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:07.336265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:07.337055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:07.342960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 233/484] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:07.349901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b2d5e-d04e-4ab6-a967-d595c2b28dfe None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:07.409359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 252/485] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:33:07.428864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac5715-b14e-4f54-8194-6e672007c54f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:07.535489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:07.542243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac5715-b14e-4f54-8194-6e672007c54f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:07.582553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8fadf-1c5e-41f1-ae81-8aacdae62f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:07.583730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8fadf-1c5e-41f1-ae81-8aacdae62f64 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:07.584214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8fadf-1c5e-41f1-ae81-8aacdae62f64 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:07.584685 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8fadf-1c5e-41f1-ae81-8aacdae62f64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:07.604612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8fadf-1c5e-41f1-ae81-8aacdae62f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-69b8fadf-1c5e-41f1-ae81-8aacdae62f64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:07.612637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:07.613489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:07.614286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:07.621975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b2d5e-d04e-4ab6-a967-d595c2b28dfe None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:07.625011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 253/486] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:07.631764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8fadf-1c5e-41f1-ae81-8aacdae62f64 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:07.700765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388d34f-bca9-41bb-b7df-9a33235ece15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:07.702462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d34f-bca9-41bb-b7df-9a33235ece15 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:07.702941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d34f-bca9-41bb-b7df-9a33235ece15 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:07.703428 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388d34f-bca9-41bb-b7df-9a33235ece15 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:07.704472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388d34f-bca9-41bb-b7df-9a33235ece15 None admin] RBAC: Adding query filter params (name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:07.704972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388d34f-bca9-41bb-b7df-9a33235ece15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:07.706552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388d34f-bca9-41bb-b7df-9a33235ece15 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:07.723118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 234/487] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:07.724749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1efced-6a61-4d7f-8fe2-a7268c1e17c1 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:07.724879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1efced-6a61-4d7f-8fe2-a7268c1e17c1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:07.725141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1efced-6a61-4d7f-8fe2-a7268c1e17c1 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:07.730282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 235/488] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:07.731057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1efced-6a61-4d7f-8fe2-a7268c1e17c1 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:07.751748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:07.777542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8fadf-1c5e-41f1-ae81-8aacdae62f64 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:07.813264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243d05-04b6-491e-9047-6c1785d89353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:07.814279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243d05-04b6-491e-9047-6c1785d89353 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:07.814782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243d05-04b6-491e-9047-6c1785d89353 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:07.815254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243d05-04b6-491e-9047-6c1785d89353 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:07.816285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243d05-04b6-491e-9047-6c1785d89353 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:07.823673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243d05-04b6-491e-9047-6c1785d89353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:07.823673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243d05-04b6-491e-9047-6c1785d89353 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:07.828540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 254/489] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:07.834294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93420c5f-94bf-46fd-91bd-03a79e6e85a1 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:07.834791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93420c5f-94bf-46fd-91bd-03a79e6e85a1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:07.835270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93420c5f-94bf-46fd-91bd-03a79e6e85a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:07.837044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1efced-6a61-4d7f-8fe2-a7268c1e17c1 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:07.856317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-93420c5f-94bf-46fd-91bd-03a79e6e85a1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:07.858343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-93420c5f-94bf-46fd-91bd-03a79e6e85a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:07.869742 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:07.880321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dbceb-1395-4f25-af42-4a44aad5b6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:07.881118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dbceb-1395-4f25-af42-4a44aad5b6d0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:07.881399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dbceb-1395-4f25-af42-4a44aad5b6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:07.881667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dbceb-1395-4f25-af42-4a44aad5b6d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:07.897451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dbceb-1395-4f25-af42-4a44aad5b6d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:07.899489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dbceb-1395-4f25-af42-4a44aad5b6d0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-a73dbceb-1395-4f25-af42-4a44aad5b6d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:07.923830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:07.924715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:07.925551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:07.925551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:07.925551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:07.925551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:07.927959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 236/490] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:07.929409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dbceb-1395-4f25-af42-4a44aad5b6d0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:07.943940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 255/491] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:07.945459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93420c5f-94bf-46fd-91bd-03a79e6e85a1 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:08.002889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:08.045564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dbceb-1395-4f25-af42-4a44aad5b6d0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:08.073055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93420c5f-94bf-46fd-91bd-03a79e6e85a1 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:08.093724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ba8d1-2d5e-4c2a-a6f7-78f9cb849650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:08.094914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ba8d1-2d5e-4c2a-a6f7-78f9cb849650 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.095201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ba8d1-2d5e-4c2a-a6f7-78f9cb849650 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.095513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ba8d1-2d5e-4c2a-a6f7-78f9cb849650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.111841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ba8d1-2d5e-4c2a-a6f7-78f9cb849650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:08.113708 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ba8d1-2d5e-4c2a-a6f7-78f9cb849650 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:08.114598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf9479-c634-4cc6-9f01-477468088023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:08.115667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf9479-c634-4cc6-9f01-477468088023 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.116149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf9479-c634-4cc6-9f01-477468088023 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.116689 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf9479-c634-4cc6-9f01-477468088023 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.117617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf9479-c634-4cc6-9f01-477468088023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:08.118170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf9479-c634-4cc6-9f01-477468088023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:08.119783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf9479-c634-4cc6-9f01-477468088023 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:08.123341 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:08.133897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 256/492] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-645ba8d1-2d5e-4c2a-a6f7-78f9cb849650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:08.134709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:08.135554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:08.140521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:08.140521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:08.140521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:08.140521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:08.140521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 237/493] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:08.140780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf9479-c634-4cc6-9f01-477468088023 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:08.140859 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ba8d1-2d5e-4c2a-a6f7-78f9cb849650 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:08.255237 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf9479-c634-4cc6-9f01-477468088023 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:08.261376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ba8d1-2d5e-4c2a-a6f7-78f9cb849650 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:08.286212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:08.302126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e43776-082e-4538-8c48-f23cbff0642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:08.305505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43776-082e-4538-8c48-f23cbff0642e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.305505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43776-082e-4538-8c48-f23cbff0642e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.305505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43776-082e-4538-8c48-f23cbff0642e None admin] PATH_INFO: `/v3/users/glance` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.310566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70eb31-5f6b-4a89-8d58-82ef128889ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:08.311929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70eb31-5f6b-4a89-8d58-82ef128889ab None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.312835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70eb31-5f6b-4a89-8d58-82ef128889ab None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.313324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e43776-082e-4538-8c48-f23cbff0642e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:08.313567 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70eb31-5f6b-4a89-8d58-82ef128889ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.314993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e43776-082e-4538-8c48-f23cbff0642e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:08.326798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70eb31-5f6b-4a89-8d58-82ef128889ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-22e43776-082e-4538-8c48-f23cbff0642e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:08.331632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:08.332661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:08.333545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 238/494] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:08.336161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e43776-082e-4538-8c48-f23cbff0642e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-5c70eb31-5f6b-4a89-8d58-82ef128889ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:08.338675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:08.339745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:08.340700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:08.346886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 257/495] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:08.348393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d52f-df41-4501-832d-320e27d20b62 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.348834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d52f-df41-4501-832d-320e27d20b62 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.349609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d52f-df41-4501-832d-320e27d20b62 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.351240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 258/496] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:08.351980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50d52f-df41-4501-832d-320e27d20b62 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:08.421685 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:08.447376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e43776-082e-4538-8c48-f23cbff0642e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:08.476343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50d52f-df41-4501-832d-320e27d20b62 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:08.494475 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad350b8-0eb5-4b70-862e-6d668649a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:08.495132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad350b8-0eb5-4b70-862e-6d668649a223 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.495441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad350b8-0eb5-4b70-862e-6d668649a223 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.495714 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad350b8-0eb5-4b70-862e-6d668649a223 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.496429 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad350b8-0eb5-4b70-862e-6d668649a223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:08.496735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad350b8-0eb5-4b70-862e-6d668649a223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:08.498100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad350b8-0eb5-4b70-862e-6d668649a223 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:08.510826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 239/497] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:08.511599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad350b8-0eb5-4b70-862e-6d668649a223 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:08.518834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1b5e-be8d-49dd-8402-dcb7d134f621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:08.519539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1b5e-be8d-49dd-8402-dcb7d134f621 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.519825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1b5e-be8d-49dd-8402-dcb7d134f621 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.520110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1b5e-be8d-49dd-8402-dcb7d134f621 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.520953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1b5e-be8d-49dd-8402-dcb7d134f621 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:08.521263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1b5e-be8d-49dd-8402-dcb7d134f621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:08.522705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1b5e-be8d-49dd-8402-dcb7d134f621 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:08.554443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:08.559860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 259/498] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Jun 17 08:33:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:08.561271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fbc61-e806-424d-b6cb-e884e58c163b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.561555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fbc61-e806-424d-b6cb-e884e58c163b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.561841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fbc61-e806-424d-b6cb-e884e58c163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.578691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-854fbc61-e806-424d-b6cb-e884e58c163b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:08.579906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-854fbc61-e806-424d-b6cb-e884e58c163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:08.617052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad350b8-0eb5-4b70-862e-6d668649a223 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:08.645429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 260/499] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:08.646530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff682ff7-e9cb-4ce1-9721-a8e518b88e73 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.646819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff682ff7-e9cb-4ce1-9721-a8e518b88e73 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.647097 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff682ff7-e9cb-4ce1-9721-a8e518b88e73 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.648539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 261/500] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:08.649078 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff682ff7-e9cb-4ce1-9721-a8e518b88e73 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:08.654191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb1706-124d-46f5-ab1b-256d7441e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:08.655480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1706-124d-46f5-ab1b-256d7441e67d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.655775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1706-124d-46f5-ab1b-256d7441e67d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.656048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb1706-124d-46f5-ab1b-256d7441e67d None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.656877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb1706-124d-46f5-ab1b-256d7441e67d None admin] RBAC: Adding query filter params (name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:08.657179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb1706-124d-46f5-ab1b-256d7441e67d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:08.659302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb1706-124d-46f5-ab1b-256d7441e67d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:08.672069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 240/501] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:08.672069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb1706-124d-46f5-ab1b-256d7441e67d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:08.703401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:08.756629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff682ff7-e9cb-4ce1-9721-a8e518b88e73 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:08.771796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb1706-124d-46f5-ab1b-256d7441e67d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:08.773269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:08.790734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4957e4-6947-44a6-aaba-236ef4f2cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:08.791564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4957e4-6947-44a6-aaba-236ef4f2cf0b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.791881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4957e4-6947-44a6-aaba-236ef4f2cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.792185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4957e4-6947-44a6-aaba-236ef4f2cf0b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.799663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4957e4-6947-44a6-aaba-236ef4f2cf0b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:08.801118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4957e4-6947-44a6-aaba-236ef4f2cf0b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:08.806173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50429b05-827a-4db5-974a-ed5386477878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:08.806824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50429b05-827a-4db5-974a-ed5386477878 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.807456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50429b05-827a-4db5-974a-ed5386477878 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.807744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50429b05-827a-4db5-974a-ed5386477878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ae4957e4-6947-44a6-aaba-236ef4f2cf0b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:08.817156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:08.818120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:08.818988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 262/502] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:08.819563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc2294-c81e-4951-9f69-c64eeafe1e02 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:08.819849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc2294-c81e-4951-9f69-c64eeafe1e02 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:08.820125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc2294-c81e-4951-9f69-c64eeafe1e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:08.838324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-ebcc2294-c81e-4951-9f69-c64eeafe1e02 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:08.839515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ebcc2294-c81e-4951-9f69-c64eeafe1e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:08.880375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50429b05-827a-4db5-974a-ed5386477878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:08.881838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50429b05-827a-4db5-974a-ed5386477878 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:08.904972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 263/503] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:08.905806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc2294-c81e-4951-9f69-c64eeafe1e02 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:08.939713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:08.981928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 241/504] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:33:08.982789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50429b05-827a-4db5-974a-ed5386477878 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:08.985019 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:09.009792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc2294-c81e-4951-9f69-c64eeafe1e02 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.042898 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705c09d-310e-4bff-88c0-32bb7cf7a44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.043642 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705c09d-310e-4bff-88c0-32bb7cf7a44d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.043924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705c09d-310e-4bff-88c0-32bb7cf7a44d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.044198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705c09d-310e-4bff-88c0-32bb7cf7a44d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.054232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705c09d-310e-4bff-88c0-32bb7cf7a44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-6705c09d-310e-4bff-88c0-32bb7cf7a44d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:09.062618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:09.063566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:09.064355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 264/505] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:09.065072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705c09d-310e-4bff-88c0-32bb7cf7a44d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:09.089187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50429b05-827a-4db5-974a-ed5386477878 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.121556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea33ce0-f651-4380-adf6-33c1da01156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.122331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea33ce0-f651-4380-adf6-33c1da01156b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.122619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea33ce0-f651-4380-adf6-33c1da01156b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.122887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea33ce0-f651-4380-adf6-33c1da01156b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.133711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea33ce0-f651-4380-adf6-33c1da01156b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:09.135158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea33ce0-f651-4380-adf6-33c1da01156b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-5ea33ce0-f651-4380-adf6-33c1da01156b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:09.152390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:09.153420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:09.154706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:09.154706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:09.154706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:09.154706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:09.155386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 242/506] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:09.156042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea33ce0-f651-4380-adf6-33c1da01156b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:09.162204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:09.168667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705c09d-310e-4bff-88c0-32bb7cf7a44d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.203406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c047ef5-45dc-4ee3-96f6-692541435244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.204070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c047ef5-45dc-4ee3-96f6-692541435244 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.204355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c047ef5-45dc-4ee3-96f6-692541435244 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.204632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c047ef5-45dc-4ee3-96f6-692541435244 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.205462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c047ef5-45dc-4ee3-96f6-692541435244 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:09.205776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c047ef5-45dc-4ee3-96f6-692541435244 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:09.207233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c047ef5-45dc-4ee3-96f6-692541435244 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:09.211871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:09.226011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 265/507] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Jun 17 08:33:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:09.227177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c047ef5-45dc-4ee3-96f6-692541435244 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:09.257796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea33ce0-f651-4380-adf6-33c1da01156b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.291117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b537f-20bc-4afd-8ec6-3e5824194cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.291936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b537f-20bc-4afd-8ec6-3e5824194cb3 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.292219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b537f-20bc-4afd-8ec6-3e5824194cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.292497 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b537f-20bc-4afd-8ec6-3e5824194cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.303567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b537f-20bc-4afd-8ec6-3e5824194cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:09.304943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b537f-20bc-4afd-8ec6-3e5824194cb3 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-f66b537f-20bc-4afd-8ec6-3e5824194cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:09.323144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:09.324028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:09.324866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:09.324866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:09.324866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:09.324866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:09.324866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 243/508] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:09.325774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b537f-20bc-4afd-8ec6-3e5824194cb3 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:09.326508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c047ef5-45dc-4ee3-96f6-692541435244 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.364243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b375f7-50ea-4a60-9a7c-4a447b680a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.365062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b375f7-50ea-4a60-9a7c-4a447b680a0d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.365366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b375f7-50ea-4a60-9a7c-4a447b680a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.365624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b375f7-50ea-4a60-9a7c-4a447b680a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.376448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b375f7-50ea-4a60-9a7c-4a447b680a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:09.377908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b375f7-50ea-4a60-9a7c-4a447b680a0d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-d8b375f7-50ea-4a60-9a7c-4a447b680a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:09.395059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:09.396072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:09.397143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:09.397143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:09.397143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:09.397143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:09.397143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 266/509] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:09.397143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b375f7-50ea-4a60-9a7c-4a447b680a0d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:09.401017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:09.431122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b537f-20bc-4afd-8ec6-3e5824194cb3 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.438870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:09.465426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868335a-fe76-4e48-857e-85160156e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.466084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868335a-fe76-4e48-857e-85160156e65c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.466368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868335a-fe76-4e48-857e-85160156e65c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.466640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868335a-fe76-4e48-857e-85160156e65c None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.467777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868335a-fe76-4e48-857e-85160156e65c None admin] RBAC: Adding query filter params (name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:09.471681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868335a-fe76-4e48-857e-85160156e65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:09.471681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868335a-fe76-4e48-857e-85160156e65c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:09.477495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 244/510] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:09.478308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868335a-fe76-4e48-857e-85160156e65c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:09.557520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b375f7-50ea-4a60-9a7c-4a447b680a0d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.590866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f6656-cecd-4699-9d8c-106e18df8a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.591552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f6656-cecd-4699-9d8c-106e18df8a62 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.591841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f6656-cecd-4699-9d8c-106e18df8a62 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.592645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f6656-cecd-4699-9d8c-106e18df8a62 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.593337 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f6656-cecd-4699-9d8c-106e18df8a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:09.593658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f6656-cecd-4699-9d8c-106e18df8a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:09.595032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f6656-cecd-4699-9d8c-106e18df8a62 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:09.606650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 267/511] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:09.607483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f6656-cecd-4699-9d8c-106e18df8a62 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:09.624913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868335a-fe76-4e48-857e-85160156e65c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.658113 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a525a2-b1de-4a2e-b5d0-2f3a3d481e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.658752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a525a2-b1de-4a2e-b5d0-2f3a3d481e57 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.659034 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a525a2-b1de-4a2e-b5d0-2f3a3d481e57 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.659305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a525a2-b1de-4a2e-b5d0-2f3a3d481e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.669178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:09.693303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:09.706898 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f6656-cecd-4699-9d8c-106e18df8a62 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.728817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a525a2-b1de-4a2e-b5d0-2f3a3d481e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:09.730300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a525a2-b1de-4a2e-b5d0-2f3a3d481e57 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:09.741262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbec223-63b9-4160-bdce-b552f0e1a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.741922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbec223-63b9-4160-bdce-b552f0e1a349 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.742207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbec223-63b9-4160-bdce-b552f0e1a349 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.742488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbec223-63b9-4160-bdce-b552f0e1a349 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.743207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbec223-63b9-4160-bdce-b552f0e1a349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:09.743563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbec223-63b9-4160-bdce-b552f0e1a349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:09.744962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbec223-63b9-4160-bdce-b552f0e1a349 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:09.756953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 268/512] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:09.757753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbec223-63b9-4160-bdce-b552f0e1a349 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:09.827184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 245/513] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:33:09.828099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a525a2-b1de-4a2e-b5d0-2f3a3d481e57 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:09.863961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbec223-63b9-4160-bdce-b552f0e1a349 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.886667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:09.894069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:09.897476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65a060-58ff-4474-be5e-7d061af0a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.898130 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65a060-58ff-4474-be5e-7d061af0a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.900849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65a060-58ff-4474-be5e-7d061af0a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.900849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65a060-58ff-4474-be5e-7d061af0a1f8 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.900849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65a060-58ff-4474-be5e-7d061af0a1f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:09.900849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65a060-58ff-4474-be5e-7d061af0a1f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:09.901279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65a060-58ff-4474-be5e-7d061af0a1f8 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:09.913299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 269/514] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:09.914092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65a060-58ff-4474-be5e-7d061af0a1f8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:09.928444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a525a2-b1de-4a2e-b5d0-2f3a3d481e57 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:09.963098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29ea28-755a-439d-a92e-c15219746976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:09.963910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29ea28-755a-439d-a92e-c15219746976 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:09.964184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29ea28-755a-439d-a92e-c15219746976 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:09.964455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29ea28-755a-439d-a92e-c15219746976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:09.975490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29ea28-755a-439d-a92e-c15219746976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:09.976936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29ea28-755a-439d-a92e-c15219746976 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-ae29ea28-755a-439d-a92e-c15219746976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:09.993704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:09.994572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:09.995443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:09.995443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:09.995443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:09.995443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:09.995443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 246/515] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:09.995720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29ea28-755a-439d-a92e-c15219746976 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:10.019012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65a060-58ff-4474-be5e-7d061af0a1f8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.052448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe349d35-5970-48d2-8e3d-0bf708a922bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.053257 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349d35-5970-48d2-8e3d-0bf708a922bc None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.053554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349d35-5970-48d2-8e3d-0bf708a922bc None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.053838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349d35-5970-48d2-8e3d-0bf708a922bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.061366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe349d35-5970-48d2-8e3d-0bf708a922bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:10.062891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe349d35-5970-48d2-8e3d-0bf708a922bc None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-fe349d35-5970-48d2-8e3d-0bf708a922bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:10.077964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:10.079006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 270/516] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Jun 17 08:33:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:10.080057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe349d35-5970-48d2-8e3d-0bf708a922bc None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:10.102141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29ea28-755a-439d-a92e-c15219746976 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.121856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:10.125615 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:10.135446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d595ee4-5ed0-41d7-b806-4fcd068f4b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.136152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d595ee4-5ed0-41d7-b806-4fcd068f4b95 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.136430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d595ee4-5ed0-41d7-b806-4fcd068f4b95 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.136707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d595ee4-5ed0-41d7-b806-4fcd068f4b95 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.137403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d595ee4-5ed0-41d7-b806-4fcd068f4b95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:10.139460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d595ee4-5ed0-41d7-b806-4fcd068f4b95 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:10.178255 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe349d35-5970-48d2-8e3d-0bf708a922bc None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.210439 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e2046-650f-41bb-85d8-99295d4d9805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.211219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2046-650f-41bb-85d8-99295d4d9805 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.211537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2046-650f-41bb-85d8-99295d4d9805 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.211819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2046-650f-41bb-85d8-99295d4d9805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.222580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e2046-650f-41bb-85d8-99295d4d9805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:10.224048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e2046-650f-41bb-85d8-99295d4d9805 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:10.230698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 247/517] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:33:09 2022] POST /identity/v3/users => generated 247 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:10.231584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d595ee4-5ed0-41d7-b806-4fcd068f4b95 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-9a3e2046-650f-41bb-85d8-99295d4d9805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:10.241353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:10.242294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:10.243202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:10.243202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:10.243202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:10.243202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:10.243202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 271/518] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:10.243965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e2046-650f-41bb-85d8-99295d4d9805 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:10.352652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d595ee4-5ed0-41d7-b806-4fcd068f4b95 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.354528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:10.361588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e2046-650f-41bb-85d8-99295d4d9805 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.391372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147fea3-c3fa-4abf-bf52-0f4696a0072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.392462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147fea3-c3fa-4abf-bf52-0f4696a0072d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.392462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147fea3-c3fa-4abf-bf52-0f4696a0072d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.392722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147fea3-c3fa-4abf-bf52-0f4696a0072d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.398734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079952-93e4-4420-8209-ec0bfb6b2ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.399425 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079952-93e4-4420-8209-ec0bfb6b2ab2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.401226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079952-93e4-4420-8209-ec0bfb6b2ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.401226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b079952-93e4-4420-8209-ec0bfb6b2ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.401413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147fea3-c3fa-4abf-bf52-0f4696a0072d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:10.401498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079952-93e4-4420-8209-ec0bfb6b2ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:10.401498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079952-93e4-4420-8209-ec0bfb6b2ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:10.401847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147fea3-c3fa-4abf-bf52-0f4696a0072d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:10.402687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b079952-93e4-4420-8209-ec0bfb6b2ab2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:10.415317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 272/519] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:10.416161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079952-93e4-4420-8209-ec0bfb6b2ab2 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-4147fea3-c3fa-4abf-bf52-0f4696a0072d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:10.417790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:10.418616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:10.419527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:10.419527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:10.419527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:10.419527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:10.419527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:10.419527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:10.419527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:10.419527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:10.419527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 248/520] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:10.419997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147fea3-c3fa-4abf-bf52-0f4696a0072d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:10.475165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:10.540656 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b079952-93e4-4420-8209-ec0bfb6b2ab2 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.548016 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147fea3-c3fa-4abf-bf52-0f4696a0072d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.578251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104126-cb66-4087-9cf1-1a2e8c02777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.578922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104126-cb66-4087-9cf1-1a2e8c02777a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.579184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104126-cb66-4087-9cf1-1a2e8c02777a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.579487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104126-cb66-4087-9cf1-1a2e8c02777a None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.580317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104126-cb66-4087-9cf1-1a2e8c02777a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:10.580625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104126-cb66-4087-9cf1-1a2e8c02777a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:10.582222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104126-cb66-4087-9cf1-1a2e8c02777a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:10.586988 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f867e4-eed7-4429-ba78-fe7914c68460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.587680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f867e4-eed7-4429-ba78-fe7914c68460 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.587969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f867e4-eed7-4429-ba78-fe7914c68460 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.588247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f867e4-eed7-4429-ba78-fe7914c68460 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.588973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f867e4-eed7-4429-ba78-fe7914c68460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:10.589282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f867e4-eed7-4429-ba78-fe7914c68460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:10.590656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f867e4-eed7-4429-ba78-fe7914c68460 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:10.604664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 273/521] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Jun 17 08:33:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:10.604664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104126-cb66-4087-9cf1-1a2e8c02777a None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:10.608795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 249/522] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:10.608795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f867e4-eed7-4429-ba78-fe7914c68460 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:10.622707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:10.712320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:10.719133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f867e4-eed7-4429-ba78-fe7914c68460 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.719465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104126-cb66-4087-9cf1-1a2e8c02777a None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.757173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d1735-ff36-47fb-8226-483041f92c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.758136 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d1735-ff36-47fb-8226-483041f92c02 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.758418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d1735-ff36-47fb-8226-483041f92c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.758690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d1735-ff36-47fb-8226-483041f92c02 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.759508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d1735-ff36-47fb-8226-483041f92c02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:10.759827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d1735-ff36-47fb-8226-483041f92c02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:10.761334 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d1735-ff36-47fb-8226-483041f92c02 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:10.766595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd0c4b-f6a9-4829-992b-0bae9afe3fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.767436 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0c4b-f6a9-4829-992b-0bae9afe3fb4 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.767725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0c4b-f6a9-4829-992b-0bae9afe3fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.768006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0c4b-f6a9-4829-992b-0bae9afe3fb4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.776140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd0c4b-f6a9-4829-992b-0bae9afe3fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:10.778466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd0c4b-f6a9-4829-992b-0bae9afe3fb4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:10.784965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 250/523] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:10.784965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d1735-ff36-47fb-8226-483041f92c02 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-08fd0c4b-f6a9-4829-992b-0bae9afe3fb4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:10.800663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:10.801670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:10.802549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 274/524] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:10.803098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd0c4b-f6a9-4829-992b-0bae9afe3fb4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:10.886908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:10.894094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d1735-ff36-47fb-8226-483041f92c02 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.916943 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd0c4b-f6a9-4829-992b-0bae9afe3fb4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:10.944171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791be42-18c5-4901-8186-fffbeffe8e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.945287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791be42-18c5-4901-8186-fffbeffe8e5a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.945985 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791be42-18c5-4901-8186-fffbeffe8e5a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.946547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791be42-18c5-4901-8186-fffbeffe8e5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.952086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21dc30-9a36-43de-bdfb-ea55eb219cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:10.952887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21dc30-9a36-43de-bdfb-ea55eb219cb8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:10.953171 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21dc30-9a36-43de-bdfb-ea55eb219cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:10.953450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21dc30-9a36-43de-bdfb-ea55eb219cb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:10.960444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21dc30-9a36-43de-bdfb-ea55eb219cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:10.961904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21dc30-9a36-43de-bdfb-ea55eb219cb8 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-cc21dc30-9a36-43de-bdfb-ea55eb219cb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:10.977526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:10.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:10.979756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:10.979756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:10.979756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:10.979756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:10.979756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:10.979756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:10.979756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:10.979756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:10.981824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:10.984490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 275/525] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:10.985520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21dc30-9a36-43de-bdfb-ea55eb219cb8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:11.055013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791be42-18c5-4901-8186-fffbeffe8e5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:11.057704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791be42-18c5-4901-8186-fffbeffe8e5a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:11.104544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21dc30-9a36-43de-bdfb-ea55eb219cb8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:11.140928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e5aea-c8c5-4623-a741-e2c63730db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:11.141485 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e5aea-c8c5-4623-a741-e2c63730db14 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:11.141767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e5aea-c8c5-4623-a741-e2c63730db14 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:11.142043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e5aea-c8c5-4623-a741-e2c63730db14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:11.142875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e5aea-c8c5-4623-a741-e2c63730db14 None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=d039be6500e74ae3a6f30821c5c19a99) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:11.143182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e5aea-c8c5-4623-a741-e2c63730db14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:11.144652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e5aea-c8c5-4623-a741-e2c63730db14 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:11.146632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:11.159400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 276/526] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:10 2022] GET /identity/v3/role_assignments?user.id=d039be6500e74ae3a6f30821c5c19a99&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:11.159400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e5aea-c8c5-4623-a741-e2c63730db14 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:11.215422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 251/527] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:33:11.216423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791be42-18c5-4901-8186-fffbeffe8e5a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:11.283025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e5aea-c8c5-4623-a741-e2c63730db14 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:11.295141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:11.322695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8bcf9-53e8-4946-8abd-0a3c97f69eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:11.323420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8bcf9-53e8-4946-8abd-0a3c97f69eb1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:11.323711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8bcf9-53e8-4946-8abd-0a3c97f69eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:11.323993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8bcf9-53e8-4946-8abd-0a3c97f69eb1 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:11.324867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8bcf9-53e8-4946-8abd-0a3c97f69eb1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:11.325437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8bcf9-53e8-4946-8abd-0a3c97f69eb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:11.327900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8bcf9-53e8-4946-8abd-0a3c97f69eb1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:11.358562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 277/528] 10.222.0.78 () {56 vars in 1139 bytes} [Fri Jun 17 08:33:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:11.358562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8bcf9-53e8-4946-8abd-0a3c97f69eb1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:11.374122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791be42-18c5-4901-8186-fffbeffe8e5a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:11.417983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19eeea-4e90-4907-b9fe-22977d5d8f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:11.418407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19eeea-4e90-4907-b9fe-22977d5d8f86 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:11.418695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19eeea-4e90-4907-b9fe-22977d5d8f86 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:11.418973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19eeea-4e90-4907-b9fe-22977d5d8f86 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:11.419803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19eeea-4e90-4907-b9fe-22977d5d8f86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:11.420164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19eeea-4e90-4907-b9fe-22977d5d8f86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:11.422206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19eeea-4e90-4907-b9fe-22977d5d8f86 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:11.446712 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:11.458722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 252/529] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:11.459904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19eeea-4e90-4907-b9fe-22977d5d8f86 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:11.502927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8bcf9-53e8-4946-8abd-0a3c97f69eb1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:11.541246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be70b6-8657-4a95-9ed0-83172dbf44e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:11.542048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be70b6-8657-4a95-9ed0-83172dbf44e7 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:11.542333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be70b6-8657-4a95-9ed0-83172dbf44e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:11.542613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be70b6-8657-4a95-9ed0-83172dbf44e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:11.554748 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be70b6-8657-4a95-9ed0-83172dbf44e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:11.556283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be70b6-8657-4a95-9ed0-83172dbf44e7 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-f0be70b6-8657-4a95-9ed0-83172dbf44e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:11.578575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:11.579549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:11.580376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:11.580376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:11.580376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:11.580376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:11.580376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 278/530] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:11.580659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be70b6-8657-4a95-9ed0-83172dbf44e7 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:11.597957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19eeea-4e90-4907-b9fe-22977d5d8f86 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:11.617326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:11.649140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d3ae0-39dc-4a29-ae6e-daab102f5e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:11.650332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d3ae0-39dc-4a29-ae6e-daab102f5e45 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:11.650833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d3ae0-39dc-4a29-ae6e-daab102f5e45 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:11.651327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d3ae0-39dc-4a29-ae6e-daab102f5e45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:11.716087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be70b6-8657-4a95-9ed0-83172dbf44e7 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:11.728845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:11.745517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d3ae0-39dc-4a29-ae6e-daab102f5e45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:11.747627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d3ae0-39dc-4a29-ae6e-daab102f5e45 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:11.760346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488deb-67f9-4d44-9aef-a0bdc18a52cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:11.761263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488deb-67f9-4d44-9aef-a0bdc18a52cd None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:11.763906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488deb-67f9-4d44-9aef-a0bdc18a52cd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:11.763906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488deb-67f9-4d44-9aef-a0bdc18a52cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:11.763906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06488deb-67f9-4d44-9aef-a0bdc18a52cd None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=bd7feb1014c44c5a9b3832bad417b47c) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:11.764758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06488deb-67f9-4d44-9aef-a0bdc18a52cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:11.767060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06488deb-67f9-4d44-9aef-a0bdc18a52cd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:11.774390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 279/531] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:11 2022] GET /identity/v3/role_assignments?user.id=bd7feb1014c44c5a9b3832bad417b47c&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:11.775390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488deb-67f9-4d44-9aef-a0bdc18a52cd None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:11.877305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 253/532] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:33:11.883323 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d3ae0-39dc-4a29-ae6e-daab102f5e45 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:11.903049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:11.996109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d3ae0-39dc-4a29-ae6e-daab102f5e45 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:12.001384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488deb-67f9-4d44-9aef-a0bdc18a52cd None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:12.035305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3acb7-4f11-4d95-91c6-a3d1288a2d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:12.036432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3acb7-4f11-4d95-91c6-a3d1288a2d33 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:12.036880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3acb7-4f11-4d95-91c6-a3d1288a2d33 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:12.037353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3acb7-4f11-4d95-91c6-a3d1288a2d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:12.052317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3acb7-4f11-4d95-91c6-a3d1288a2d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:12.054605 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3acb7-4f11-4d95-91c6-a3d1288a2d33 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:12.059965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7ce50-789b-452e-b7f0-fa64defcbf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:12.061349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7ce50-789b-452e-b7f0-fa64defcbf67 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:12.061899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7ce50-789b-452e-b7f0-fa64defcbf67 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:12.062421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7ce50-789b-452e-b7f0-fa64defcbf67 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:12.063232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7ce50-789b-452e-b7f0-fa64defcbf67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:12.063571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7ce50-789b-452e-b7f0-fa64defcbf67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:12.064956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7ce50-789b-452e-b7f0-fa64defcbf67 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:12.083380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 280/533] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:12.084639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7ce50-789b-452e-b7f0-fa64defcbf67 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-57b3acb7-4f11-4d95-91c6-a3d1288a2d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:12.096122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:12.097025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:12.097866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:12.097866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:12.097866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:12.097866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:12.097866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 254/534] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:12.104296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3acb7-4f11-4d95-91c6-a3d1288a2d33 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:12.117982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:12.217067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:12.234801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7ce50-789b-452e-b7f0-fa64defcbf67 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:12.255747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3acb7-4f11-4d95-91c6-a3d1288a2d33 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:12.294833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5671732-c5e1-40aa-a962-9ccec64e529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:12.296787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5671732-c5e1-40aa-a962-9ccec64e529b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:12.297222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5671732-c5e1-40aa-a962-9ccec64e529b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:12.297646 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5671732-c5e1-40aa-a962-9ccec64e529b None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:12.298509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5671732-c5e1-40aa-a962-9ccec64e529b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:12.298987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5671732-c5e1-40aa-a962-9ccec64e529b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:12.300822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5671732-c5e1-40aa-a962-9ccec64e529b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:12.315407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 255/535] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:12.320448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5671732-c5e1-40aa-a962-9ccec64e529b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:12.342782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4c87-49fa-486c-9b90-1d3cb40018f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:12.343615 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4c87-49fa-486c-9b90-1d3cb40018f1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:12.343901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4c87-49fa-486c-9b90-1d3cb40018f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:12.344179 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4c87-49fa-486c-9b90-1d3cb40018f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:12.360459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff4c87-49fa-486c-9b90-1d3cb40018f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:12.361931 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff4c87-49fa-486c-9b90-1d3cb40018f1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-0eff4c87-49fa-486c-9b90-1d3cb40018f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:12.384071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:12.385131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:12.386183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:12.386183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:12.386183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:12.386183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:12.386183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:12.386183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:12.386183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:12.386183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:12.396104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 281/536] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:12.397678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4c87-49fa-486c-9b90-1d3cb40018f1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:12.454525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5671732-c5e1-40aa-a962-9ccec64e529b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:12.491509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:12.508931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaef369-ceb8-4c17-a856-33fd957e52ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:12.510119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaef369-ceb8-4c17-a856-33fd957e52ad None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:12.510543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaef369-ceb8-4c17-a856-33fd957e52ad None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:12.510970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaef369-ceb8-4c17-a856-33fd957e52ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:12.526411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaef369-ceb8-4c17-a856-33fd957e52ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:12.528157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaef369-ceb8-4c17-a856-33fd957e52ad None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-2aaef369-ceb8-4c17-a856-33fd957e52ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:12.554071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:12.555117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:12.556098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:12.556098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:12.556098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:12.556098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:12.556098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:12.556098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:12.556098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:12.556098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:12.558062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 256/537] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:12.559490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486cb37-23c6-40b2-8da6-cafdc55237df None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:12.559912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486cb37-23c6-40b2-8da6-cafdc55237df None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:12.560328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486cb37-23c6-40b2-8da6-cafdc55237df None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:12.562667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 257/538] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:12.563757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486cb37-23c6-40b2-8da6-cafdc55237df None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:12.614351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:12.627451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4c87-49fa-486c-9b90-1d3cb40018f1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:12.670782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533bcc5-9aa1-40d6-a0d6-ac34b82cc8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:12.671508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533bcc5-9aa1-40d6-a0d6-ac34b82cc8f2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:12.671930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533bcc5-9aa1-40d6-a0d6-ac34b82cc8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:12.672220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533bcc5-9aa1-40d6-a0d6-ac34b82cc8f2 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:12.673110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533bcc5-9aa1-40d6-a0d6-ac34b82cc8f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:12.673433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533bcc5-9aa1-40d6-a0d6-ac34b82cc8f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:12.674887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533bcc5-9aa1-40d6-a0d6-ac34b82cc8f2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:12.680175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486cb37-23c6-40b2-8da6-cafdc55237df None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:12.698434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 282/539] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:12.698434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a582b-55b5-4314-92b2-a7ab28156991 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:12.698434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a582b-55b5-4314-92b2-a7ab28156991 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:12.698434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a582b-55b5-4314-92b2-a7ab28156991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:12.717808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-ec3a582b-55b5-4314-92b2-a7ab28156991 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:12.719026 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ec3a582b-55b5-4314-92b2-a7ab28156991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:12.722998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b7852-8849-47d3-9a57-0ae627a8e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:12.723930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b7852-8849-47d3-9a57-0ae627a8e149 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:12.724348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b7852-8849-47d3-9a57-0ae627a8e149 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:12.724777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b7852-8849-47d3-9a57-0ae627a8e149 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:12.725739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b7852-8849-47d3-9a57-0ae627a8e149 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:12.726182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b7852-8849-47d3-9a57-0ae627a8e149 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:12.727922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b7852-8849-47d3-9a57-0ae627a8e149 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:12.741834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 258/540] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:12.742936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b7852-8849-47d3-9a57-0ae627a8e149 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:12.796182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:12.807595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 283/541] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:12.808481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a582b-55b5-4314-92b2-a7ab28156991 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:12.851864 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b7852-8849-47d3-9a57-0ae627a8e149 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:12.888293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ef4c4-cb15-4787-8540-86aa24f4fb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:12.890038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ef4c4-cb15-4787-8540-86aa24f4fb7a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:12.890459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ef4c4-cb15-4787-8540-86aa24f4fb7a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:12.890906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ef4c4-cb15-4787-8540-86aa24f4fb7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:12.892039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ef4c4-cb15-4787-8540-86aa24f4fb7a None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=6aa3618089794b938018ff2666afebe3) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:12.892513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ef4c4-cb15-4787-8540-86aa24f4fb7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:12.894128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ef4c4-cb15-4787-8540-86aa24f4fb7a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:12.900524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 259/542] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:12 2022] GET /identity/v3/role_assignments?user.id=6aa3618089794b938018ff2666afebe3&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:12.906279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ef4c4-cb15-4787-8540-86aa24f4fb7a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:12.913630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:12.933525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a582b-55b5-4314-92b2-a7ab28156991 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:12.999332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299dfe0-0b9e-428f-b30c-0e50a43502f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:12.999932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299dfe0-0b9e-428f-b30c-0e50a43502f2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:13.000221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299dfe0-0b9e-428f-b30c-0e50a43502f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:13.000505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299dfe0-0b9e-428f-b30c-0e50a43502f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:13.001368 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299dfe0-0b9e-428f-b30c-0e50a43502f2 None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=024e0e53cfdb42e88dfdfde7a79e8c75) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:13.001687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299dfe0-0b9e-428f-b30c-0e50a43502f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:13.003370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299dfe0-0b9e-428f-b30c-0e50a43502f2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:13.019266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 284/543] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:12 2022] GET /identity/v3/role_assignments?user.id=024e0e53cfdb42e88dfdfde7a79e8c75&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:13.039472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ef4c4-cb15-4787-8540-86aa24f4fb7a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:13.056341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:13.081028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8daef-37a6-47d7-bb22-e102e7aee516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:13.082190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8daef-37a6-47d7-bb22-e102e7aee516 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:13.082674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8daef-37a6-47d7-bb22-e102e7aee516 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:13.084828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8daef-37a6-47d7-bb22-e102e7aee516 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:13.096953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8daef-37a6-47d7-bb22-e102e7aee516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-9dc8daef-37a6-47d7-bb22-e102e7aee516 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:13.105573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:13.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:13.107288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:13.111279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 260/544] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:13.120770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299dfe0-0b9e-428f-b30c-0e50a43502f2 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:13.247091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299dfe0-0b9e-428f-b30c-0e50a43502f2 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:13.285175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866fb03-c25c-40c9-8473-5721e45a11f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:13.285848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866fb03-c25c-40c9-8473-5721e45a11f1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:13.286137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866fb03-c25c-40c9-8473-5721e45a11f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:13.286416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866fb03-c25c-40c9-8473-5721e45a11f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:13.287172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866fb03-c25c-40c9-8473-5721e45a11f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:13.287516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866fb03-c25c-40c9-8473-5721e45a11f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:13.288982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866fb03-c25c-40c9-8473-5721e45a11f1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:13.299273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 285/545] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:13.304795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8daef-37a6-47d7-bb22-e102e7aee516 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:13.428538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8daef-37a6-47d7-bb22-e102e7aee516 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:13.525272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac94ee-2205-41b4-93b6-91073ce19194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:13.526083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac94ee-2205-41b4-93b6-91073ce19194 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:13.526365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac94ee-2205-41b4-93b6-91073ce19194 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:13.526639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac94ee-2205-41b4-93b6-91073ce19194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:13.541246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac94ee-2205-41b4-93b6-91073ce19194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:13.542753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac94ee-2205-41b4-93b6-91073ce19194 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-acac94ee-2205-41b4-93b6-91073ce19194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:13.571196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:13.572205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:13.573659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:13.573659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:13.573659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:13.573659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:13.573659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 261/546] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:13.578601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866fb03-c25c-40c9-8473-5721e45a11f1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:13.597311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:13.615206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8b48d-5576-45e6-814a-2c8d601481b1 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:13.615567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8b48d-5576-45e6-814a-2c8d601481b1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:13.616088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8b48d-5576-45e6-814a-2c8d601481b1 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:13.617290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 262/547] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:13.624370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a256-17f2-4a51-ba6b-bc8067b29303 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:13.624645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a256-17f2-4a51-ba6b-bc8067b29303 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:13.624921 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58a256-17f2-4a51-ba6b-bc8067b29303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:13.660378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-4a58a256-17f2-4a51-ba6b-bc8067b29303 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:13.661580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4a58a256-17f2-4a51-ba6b-bc8067b29303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:13.691808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:13.736810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866fb03-c25c-40c9-8473-5721e45a11f1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:13.791115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 263/548] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:33:13.802862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301315-dee7-41be-aa9c-f838dbd5d563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:13.803561 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301315-dee7-41be-aa9c-f838dbd5d563 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:13.803847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301315-dee7-41be-aa9c-f838dbd5d563 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:13.804126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301315-dee7-41be-aa9c-f838dbd5d563 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:13.804852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f301315-dee7-41be-aa9c-f838dbd5d563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:13.805159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f301315-dee7-41be-aa9c-f838dbd5d563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:13.806537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f301315-dee7-41be-aa9c-f838dbd5d563 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:13.815581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58a256-17f2-4a51-ba6b-bc8067b29303 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:13.832335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 286/549] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:13.837960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301315-dee7-41be-aa9c-f838dbd5d563 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:13.974304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:14.010647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58a256-17f2-4a51-ba6b-bc8067b29303 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:14.039186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301315-dee7-41be-aa9c-f838dbd5d563 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:14.081909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27fdf5-1042-48ec-ae37-a64bf969a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:14.082720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27fdf5-1042-48ec-ae37-a64bf969a2cb None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:14.082999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27fdf5-1042-48ec-ae37-a64bf969a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:14.083271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27fdf5-1042-48ec-ae37-a64bf969a2cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:14.102305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27fdf5-1042-48ec-ae37-a64bf969a2cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:14.111289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afba9a-bb69-4dff-bb9f-2e72a97183b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:14.112114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afba9a-bb69-4dff-bb9f-2e72a97183b1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:14.112391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afba9a-bb69-4dff-bb9f-2e72a97183b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:14.112664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afba9a-bb69-4dff-bb9f-2e72a97183b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-bc27fdf5-1042-48ec-ae37-a64bf969a2cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:14.119233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:14.121427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:14.123854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:14.125528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afba9a-bb69-4dff-bb9f-2e72a97183b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:14.125528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afba9a-bb69-4dff-bb9f-2e72a97183b1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:14.126995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 264/550] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:14.134741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27fdf5-1042-48ec-ae37-a64bf969a2cb None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:14.148988 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-52afba9a-bb69-4dff-bb9f-2e72a97183b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:14.156744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:14.157664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:14.158555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:14.158555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:14.158555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:14.158555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:14.158555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:14.158555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:14.158555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:14.158555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:14.158555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:14.158555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:14.163328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 287/551] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:14.169072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afba9a-bb69-4dff-bb9f-2e72a97183b1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:14.278962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27fdf5-1042-48ec-ae37-a64bf969a2cb None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:14.345343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a0be2-5417-4c83-8da1-bceb1376443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:14.346020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0be2-5417-4c83-8da1-bceb1376443a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:14.346303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0be2-5417-4c83-8da1-bceb1376443a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:14.346593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0be2-5417-4c83-8da1-bceb1376443a None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:14.347319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a0be2-5417-4c83-8da1-bceb1376443a None admin] RBAC: Adding query filter params (name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:14.347894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a0be2-5417-4c83-8da1-bceb1376443a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:14.350000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a0be2-5417-4c83-8da1-bceb1376443a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:14.361347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 265/552] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:14.362133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afba9a-bb69-4dff-bb9f-2e72a97183b1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:14.362818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf149d-a07e-42b2-8e29-e07e4393edca None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:14.363112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf149d-a07e-42b2-8e29-e07e4393edca None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:14.363410 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf149d-a07e-42b2-8e29-e07e4393edca None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:14.364895 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 266/553] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:14.366439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf149d-a07e-42b2-8e29-e07e4393edca None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:14.401597 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:14.411810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08399a9b-0979-4582-8b18-092444034385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:14.417240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08399a9b-0979-4582-8b18-092444034385 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:14.417240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08399a9b-0979-4582-8b18-092444034385 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:14.417240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08399a9b-0979-4582-8b18-092444034385 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:14.417240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08399a9b-0979-4582-8b18-092444034385 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:14.417240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08399a9b-0979-4582-8b18-092444034385 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:14.417240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08399a9b-0979-4582-8b18-092444034385 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:14.441139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 288/554] 10.222.0.78 () {56 vars in 1135 bytes} [Fri Jun 17 08:33:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:14.448345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07dc0e-0ca2-4c10-b855-0b3ae61497d3 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:14.448640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07dc0e-0ca2-4c10-b855-0b3ae61497d3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:14.448921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07dc0e-0ca2-4c10-b855-0b3ae61497d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:14.461653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:14.470460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-8b07dc0e-0ca2-4c10-b855-0b3ae61497d3 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:14.471968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-8b07dc0e-0ca2-4c10-b855-0b3ae61497d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:14.488603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf149d-a07e-42b2-8e29-e07e4393edca None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:14.531435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b1438-548a-4a1c-8c29-ee58d9b5ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:14.532223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b1438-548a-4a1c-8c29-ee58d9b5ab58 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:14.532510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b1438-548a-4a1c-8c29-ee58d9b5ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:14.532791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b1438-548a-4a1c-8c29-ee58d9b5ab58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:14.544801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b1438-548a-4a1c-8c29-ee58d9b5ab58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:14.546237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b1438-548a-4a1c-8c29-ee58d9b5ab58 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:14.555605 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 289/555] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:14.556735 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07dc0e-0ca2-4c10-b855-0b3ae61497d3 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-db6b1438-548a-4a1c-8c29-ee58d9b5ab58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:14.571820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:14.572747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:14.573662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:14.573662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:14.573662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:14.573662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:14.573662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 267/556] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:14.574341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b1438-548a-4a1c-8c29-ee58d9b5ab58 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:14.675180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07dc0e-0ca2-4c10-b855-0b3ae61497d3 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:14.691987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:14.694510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b1438-548a-4a1c-8c29-ee58d9b5ab58 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:14.711731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9631-6afe-4003-90ed-f41597fea0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:14.712691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9631-6afe-4003-90ed-f41597fea0a5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:14.713179 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9631-6afe-4003-90ed-f41597fea0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:14.713648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9631-6afe-4003-90ed-f41597fea0a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:14.723379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:14.731827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467e407-a52b-414c-9393-5d2476cdf291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:14.734093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467e407-a52b-414c-9393-5d2476cdf291 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:14.734393 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467e407-a52b-414c-9393-5d2476cdf291 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:14.734676 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467e407-a52b-414c-9393-5d2476cdf291 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:14.735746 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467e407-a52b-414c-9393-5d2476cdf291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:14.736059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467e407-a52b-414c-9393-5d2476cdf291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:14.737501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467e407-a52b-414c-9393-5d2476cdf291 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:14.751657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 268/557] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:14.753119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467e407-a52b-414c-9393-5d2476cdf291 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:14.787319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b9631-6afe-4003-90ed-f41597fea0a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:14.789004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b9631-6afe-4003-90ed-f41597fea0a5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:14.866513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467e407-a52b-414c-9393-5d2476cdf291 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:14.896355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 290/558] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:33:14.897460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9631-6afe-4003-90ed-f41597fea0a5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:14.906079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b27d-12b0-4ca3-9af9-af3ae6d66c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:14.907065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b27d-12b0-4ca3-9af9-af3ae6d66c5a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:14.907549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b27d-12b0-4ca3-9af9-af3ae6d66c5a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:14.908143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b27d-12b0-4ca3-9af9-af3ae6d66c5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:14.918127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:14.921534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738b27d-12b0-4ca3-9af9-af3ae6d66c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-2738b27d-12b0-4ca3-9af9-af3ae6d66c5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:14.929693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:14.937383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 269/559] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:14.938247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b27d-12b0-4ca3-9af9-af3ae6d66c5a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.000992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:15.031433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9631-6afe-4003-90ed-f41597fea0a5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:15.054948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0b4e1-05cc-4757-91ba-cc83fda8ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:15.056554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0b4e1-05cc-4757-91ba-cc83fda8ec87 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.057042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0b4e1-05cc-4757-91ba-cc83fda8ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.057535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0b4e1-05cc-4757-91ba-cc83fda8ec87 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.064659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b27d-12b0-4ca3-9af9-af3ae6d66c5a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:15.065752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0b4e1-05cc-4757-91ba-cc83fda8ec87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:15.067461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0b4e1-05cc-4757-91ba-cc83fda8ec87 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-20e0b4e1-05cc-4757-91ba-cc83fda8ec87 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:15.083586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:15.084684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:15.085636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:15.085636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:15.085636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:15.085636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:15.085636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:15.085636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:15.085636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:15.085636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:15.085636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:33:15.085636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:15.088253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 291/560] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:15.089364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0b4e1-05cc-4757-91ba-cc83fda8ec87 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.101867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610a9fe-feaa-4f17-8099-1fdc5777b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:15.102596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610a9fe-feaa-4f17-8099-1fdc5777b516 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.102885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610a9fe-feaa-4f17-8099-1fdc5777b516 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.103166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610a9fe-feaa-4f17-8099-1fdc5777b516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.115912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610a9fe-feaa-4f17-8099-1fdc5777b516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:15.117379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610a9fe-feaa-4f17-8099-1fdc5777b516 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-1610a9fe-feaa-4f17-8099-1fdc5777b516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:15.136782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:15.137731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:15.138635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:15.138635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:15.138635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:15.138635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:15.142948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 270/561] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:15.143983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610a9fe-feaa-4f17-8099-1fdc5777b516 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.176024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:15.199094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0b4e1-05cc-4757-91ba-cc83fda8ec87 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:15.236698 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e6e20-28cf-4a68-b951-fa60c2cc02f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:15.237761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e6e20-28cf-4a68-b951-fa60c2cc02f5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.238249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e6e20-28cf-4a68-b951-fa60c2cc02f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.238740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e6e20-28cf-4a68-b951-fa60c2cc02f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.239710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e6e20-28cf-4a68-b951-fa60c2cc02f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:15.240243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e6e20-28cf-4a68-b951-fa60c2cc02f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:15.241817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e6e20-28cf-4a68-b951-fa60c2cc02f5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:15.255069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610a9fe-feaa-4f17-8099-1fdc5777b516 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:15.255440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 292/562] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:15.256524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e6e20-28cf-4a68-b951-fa60c2cc02f5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.288504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639e2fd-acfa-412e-b5af-eb41e8ed5517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:15.289235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639e2fd-acfa-412e-b5af-eb41e8ed5517 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.289737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639e2fd-acfa-412e-b5af-eb41e8ed5517 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.289854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639e2fd-acfa-412e-b5af-eb41e8ed5517 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.290678 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639e2fd-acfa-412e-b5af-eb41e8ed5517 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:15.291073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639e2fd-acfa-412e-b5af-eb41e8ed5517 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:15.292652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639e2fd-acfa-412e-b5af-eb41e8ed5517 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:15.335802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 271/563] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Jun 17 08:33:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:15.336691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639e2fd-acfa-412e-b5af-eb41e8ed5517 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.366862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e6e20-28cf-4a68-b951-fa60c2cc02f5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:15.380240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:15.403856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eadc7-5bdc-4c70-b4c1-3872b79550ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:15.405148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eadc7-5bdc-4c70-b4c1-3872b79550ff None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.405440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eadc7-5bdc-4c70-b4c1-3872b79550ff None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.405719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eadc7-5bdc-4c70-b4c1-3872b79550ff None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.406451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60eadc7-5bdc-4c70-b4c1-3872b79550ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:15.406767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60eadc7-5bdc-4c70-b4c1-3872b79550ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:15.408169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60eadc7-5bdc-4c70-b4c1-3872b79550ff None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:15.417467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:15.423235 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 293/564] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:15.424308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eadc7-5bdc-4c70-b4c1-3872b79550ff None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.455879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639e2fd-acfa-412e-b5af-eb41e8ed5517 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:15.498275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807f97e-7094-4418-8060-f18e16ada415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:15.499237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807f97e-7094-4418-8060-f18e16ada415 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.499608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807f97e-7094-4418-8060-f18e16ada415 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.499943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807f97e-7094-4418-8060-f18e16ada415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.511880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807f97e-7094-4418-8060-f18e16ada415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:15.513332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807f97e-7094-4418-8060-f18e16ada415 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-8807f97e-7094-4418-8060-f18e16ada415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:15.531925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:15.532964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:15.533830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:15.533830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:15.533830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:15.533830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:15.533830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 272/565] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:15.534500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f126f5-a9be-4595-9dd0-a9a0baffb0c9 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.534604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f126f5-a9be-4595-9dd0-a9a0baffb0c9 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.535096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f126f5-a9be-4595-9dd0-a9a0baffb0c9 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.539280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 273/566] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:15.539280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f126f5-a9be-4595-9dd0-a9a0baffb0c9 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.547424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eadc7-5bdc-4c70-b4c1-3872b79550ff None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:15.549674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:15.582601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb196c06-c93d-473d-aeaa-731ddeb76880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:15.583420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196c06-c93d-473d-aeaa-731ddeb76880 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.583710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196c06-c93d-473d-aeaa-731ddeb76880 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.584025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196c06-c93d-473d-aeaa-731ddeb76880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.594276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb196c06-c93d-473d-aeaa-731ddeb76880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:15.595719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb196c06-c93d-473d-aeaa-731ddeb76880 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-fb196c06-c93d-473d-aeaa-731ddeb76880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:15.613515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:15.614416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:15.615306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:15.615306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:15.615306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:15.615306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:15.615306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 294/567] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:15.616088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd74db0-048e-4c88-840c-649a6e420702 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.616208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd74db0-048e-4c88-840c-649a6e420702 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.616490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd74db0-048e-4c88-840c-649a6e420702 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.618191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 295/568] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:15.618481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd74db0-048e-4c88-840c-649a6e420702 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.643300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f126f5-a9be-4595-9dd0-a9a0baffb0c9 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:15.671759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:15.677073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5e55c-51e6-4df9-af0f-40166c706caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:15.682053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5e55c-51e6-4df9-af0f-40166c706caf None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.682053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5e55c-51e6-4df9-af0f-40166c706caf None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.682053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5e55c-51e6-4df9-af0f-40166c706caf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.685160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5e55c-51e6-4df9-af0f-40166c706caf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:15.687164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5e55c-51e6-4df9-af0f-40166c706caf None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-e7d5e55c-51e6-4df9-af0f-40166c706caf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:15.700973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:15.702795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:15.703928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:15.703928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:15.703928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:15.703928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:15.703928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:15.703928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:15.703928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:15.703928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:15.703928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 274/569] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:15.704540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b1cf8-85e2-4f96-84f7-41a7aafcbafa None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.704540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b1cf8-85e2-4f96-84f7-41a7aafcbafa None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.704540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b1cf8-85e2-4f96-84f7-41a7aafcbafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.720318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-890b1cf8-85e2-4f96-84f7-41a7aafcbafa None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:15.721506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-890b1cf8-85e2-4f96-84f7-41a7aafcbafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:15.730718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd74db0-048e-4c88-840c-649a6e420702 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:15.765289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb706c-e2df-4350-a70a-2d93b7979ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:15.765943 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb706c-e2df-4350-a70a-2d93b7979ecd None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.766227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb706c-e2df-4350-a70a-2d93b7979ecd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.766506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb706c-e2df-4350-a70a-2d93b7979ecd None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.767225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb706c-e2df-4350-a70a-2d93b7979ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:15.767560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb706c-e2df-4350-a70a-2d93b7979ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:15.768941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb706c-e2df-4350-a70a-2d93b7979ecd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:15.780806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 296/570] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:15.781737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb706c-e2df-4350-a70a-2d93b7979ecd None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.786323 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:15.791564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 275/571] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:15.796518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320036-472b-49ad-84c3-548c2cfd58b5 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.796518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320036-472b-49ad-84c3-548c2cfd58b5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.796518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320036-472b-49ad-84c3-548c2cfd58b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.811319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-4b320036-472b-49ad-84c3-548c2cfd58b5 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:15.812776 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4b320036-472b-49ad-84c3-548c2cfd58b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:15.879956 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 276/572] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:15.880782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b320036-472b-49ad-84c3-548c2cfd58b5 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.898706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb706c-e2df-4350-a70a-2d93b7979ecd None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:15.909592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:15.932387 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7d404-ccee-42b5-a0ba-69282a6825fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:15.937225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7d404-ccee-42b5-a0ba-69282a6825fc None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:15.937225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7d404-ccee-42b5-a0ba-69282a6825fc None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:15.937225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7d404-ccee-42b5-a0ba-69282a6825fc None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:15.937225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7d404-ccee-42b5-a0ba-69282a6825fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:15.937225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7d404-ccee-42b5-a0ba-69282a6825fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:15.937225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7d404-ccee-42b5-a0ba-69282a6825fc None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:15.948180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 297/573] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:15.949179 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7d404-ccee-42b5-a0ba-69282a6825fc None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:15.983107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b320036-472b-49ad-84c3-548c2cfd58b5 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.012164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:16.017929 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46069f-1fcd-49d9-844d-32861683329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.018587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46069f-1fcd-49d9-844d-32861683329c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.018868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46069f-1fcd-49d9-844d-32861683329c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.019150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46069f-1fcd-49d9-844d-32861683329c None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.019966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46069f-1fcd-49d9-844d-32861683329c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:16.025525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46069f-1fcd-49d9-844d-32861683329c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:16.025525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46069f-1fcd-49d9-844d-32861683329c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:16.033336 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 277/574] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:16.034160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46069f-1fcd-49d9-844d-32861683329c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.053911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7d404-ccee-42b5-a0ba-69282a6825fc None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.087676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c43d-03c1-46f5-a59d-308ce2bcbad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.088461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c43d-03c1-46f5-a59d-308ce2bcbad7 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.088738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c43d-03c1-46f5-a59d-308ce2bcbad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.089011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c43d-03c1-46f5-a59d-308ce2bcbad7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.096082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31c43d-03c1-46f5-a59d-308ce2bcbad7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:16.097533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31c43d-03c1-46f5-a59d-308ce2bcbad7 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ae31c43d-03c1-46f5-a59d-308ce2bcbad7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:16.112371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:16.113500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 298/575] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:16.114431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c43d-03c1-46f5-a59d-308ce2bcbad7 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.134574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46069f-1fcd-49d9-844d-32861683329c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.146482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:16.167367 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff5e89-b592-4170-95d4-94c67b3d2e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.168164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff5e89-b592-4170-95d4-94c67b3d2e9d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.168447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff5e89-b592-4170-95d4-94c67b3d2e9d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.168728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff5e89-b592-4170-95d4-94c67b3d2e9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.179759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff5e89-b592-4170-95d4-94c67b3d2e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-07ff5e89-b592-4170-95d4-94c67b3d2e9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:16.188599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:16.189663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:16.190522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 278/576] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:16.191238 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff5e89-b592-4170-95d4-94c67b3d2e9d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.217720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c43d-03c1-46f5-a59d-308ce2bcbad7 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.246114 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:16.251912 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15dba-44e4-442f-89b7-e5daca4af0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.252702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15dba-44e4-442f-89b7-e5daca4af0a7 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.252979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15dba-44e4-442f-89b7-e5daca4af0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.253253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15dba-44e4-442f-89b7-e5daca4af0a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.263044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af15dba-44e4-442f-89b7-e5daca4af0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-9af15dba-44e4-442f-89b7-e5daca4af0a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:16.271134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:16.272300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 299/577] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:16.273155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15dba-44e4-442f-89b7-e5daca4af0a7 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.299864 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff5e89-b592-4170-95d4-94c67b3d2e9d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.333324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d8808-5bf6-4dc6-9362-e4b50c77876b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.334111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d8808-5bf6-4dc6-9362-e4b50c77876b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.334396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d8808-5bf6-4dc6-9362-e4b50c77876b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.334677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d8808-5bf6-4dc6-9362-e4b50c77876b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.341219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d8808-5bf6-4dc6-9362-e4b50c77876b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:16.343272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d8808-5bf6-4dc6-9362-e4b50c77876b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-6e6d8808-5bf6-4dc6-9362-e4b50c77876b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:16.357179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:16.358575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:16.359496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:16.359496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:16.359496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:16.359496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:16.359496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:16.359496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:16.359496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:16.359496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:16.359496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 279/578] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:16.359978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d8808-5bf6-4dc6-9362-e4b50c77876b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.366552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:16.376556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15dba-44e4-442f-89b7-e5daca4af0a7 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.420954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d2dd8-b3df-4b85-bcc1-fc8cc145fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.421529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2dd8-b3df-4b85-bcc1-fc8cc145fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.421800 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2dd8-b3df-4b85-bcc1-fc8cc145fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.422072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2dd8-b3df-4b85-bcc1-fc8cc145fcd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.422902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d2dd8-b3df-4b85-bcc1-fc8cc145fcd5 None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=46e2b769ba9b46778c96b2a04d45612d) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:16.423211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d2dd8-b3df-4b85-bcc1-fc8cc145fcd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:16.424878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d2dd8-b3df-4b85-bcc1-fc8cc145fcd5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:16.431431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 300/579] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/role_assignments?user.id=46e2b769ba9b46778c96b2a04d45612d&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:16.432071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d2dd8-b3df-4b85-bcc1-fc8cc145fcd5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.484063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d8808-5bf6-4dc6-9362-e4b50c77876b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.498237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:16.524107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c58187-1c30-4b58-b081-7ecc4d593d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.524807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c58187-1c30-4b58-b081-7ecc4d593d00 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.525088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c58187-1c30-4b58-b081-7ecc4d593d00 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.525363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c58187-1c30-4b58-b081-7ecc4d593d00 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.526211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c58187-1c30-4b58-b081-7ecc4d593d00 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:16.526523 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c58187-1c30-4b58-b081-7ecc4d593d00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:16.528017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c58187-1c30-4b58-b081-7ecc4d593d00 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:16.554507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 280/580] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:16.555532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c58187-1c30-4b58-b081-7ecc4d593d00 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.558023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d2dd8-b3df-4b85-bcc1-fc8cc145fcd5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.600807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59427d6c-050c-4790-9636-cb511183c377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.601498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59427d6c-050c-4790-9636-cb511183c377 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.601782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59427d6c-050c-4790-9636-cb511183c377 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.602062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59427d6c-050c-4790-9636-cb511183c377 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.602844 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59427d6c-050c-4790-9636-cb511183c377 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:16.603852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59427d6c-050c-4790-9636-cb511183c377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:16.604831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59427d6c-050c-4790-9636-cb511183c377 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:16.618164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 301/581] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:16.619042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59427d6c-050c-4790-9636-cb511183c377 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.644562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:16.688872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c58187-1c30-4b58-b081-7ecc4d593d00 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.726343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e4cd-216a-4832-96f9-a7ed8cfef94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.727251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e4cd-216a-4832-96f9-a7ed8cfef94a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.727607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e4cd-216a-4832-96f9-a7ed8cfef94a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.727832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303e4cd-216a-4832-96f9-a7ed8cfef94a None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.728565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303e4cd-216a-4832-96f9-a7ed8cfef94a None admin] RBAC: Adding query filter params (name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:16.728869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303e4cd-216a-4832-96f9-a7ed8cfef94a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:16.730258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303e4cd-216a-4832-96f9-a7ed8cfef94a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:16.731079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59427d6c-050c-4790-9636-cb511183c377 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.743396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 281/582] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:16.743396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e4cd-216a-4832-96f9-a7ed8cfef94a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.774603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5452058-3cb1-452c-a654-136ca502b7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.775274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452058-3cb1-452c-a654-136ca502b7f5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.775591 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452058-3cb1-452c-a654-136ca502b7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.775870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5452058-3cb1-452c-a654-136ca502b7f5 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.776655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5452058-3cb1-452c-a654-136ca502b7f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:16.776949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:16.777051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5452058-3cb1-452c-a654-136ca502b7f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:16.778388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5452058-3cb1-452c-a654-136ca502b7f5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:16.795530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 302/583] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:16.796493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5452058-3cb1-452c-a654-136ca502b7f5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.851907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303e4cd-216a-4832-96f9-a7ed8cfef94a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.878429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:16.889004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0473-c85b-489d-ba2d-93fe45d3b1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.889810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0473-c85b-489d-ba2d-93fe45d3b1dd None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.890088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0473-c85b-489d-ba2d-93fe45d3b1dd None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.890363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0473-c85b-489d-ba2d-93fe45d3b1dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.901665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def0473-c85b-489d-ba2d-93fe45d3b1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:16.903127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def0473-c85b-489d-ba2d-93fe45d3b1dd None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:16.903230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5452058-3cb1-452c-a654-136ca502b7f5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-9def0473-c85b-489d-ba2d-93fe45d3b1dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:16.921995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:16.923077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:16.924020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:16.924020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:16.924020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:16.924020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:16.924020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 282/584] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:16.924396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0473-c85b-489d-ba2d-93fe45d3b1dd None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:16.945355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204cfc6-2267-4c8b-a0ec-0eacc8380ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:16.946502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204cfc6-2267-4c8b-a0ec-0eacc8380ad5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:16.946792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204cfc6-2267-4c8b-a0ec-0eacc8380ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:16.947247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204cfc6-2267-4c8b-a0ec-0eacc8380ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:16.958854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204cfc6-2267-4c8b-a0ec-0eacc8380ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:16.960343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204cfc6-2267-4c8b-a0ec-0eacc8380ad5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-2204cfc6-2267-4c8b-a0ec-0eacc8380ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:16.977376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:16.978265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:16.979154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:16.979154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:16.979154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:16.979154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:16.979154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 303/585] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:16.980021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204cfc6-2267-4c8b-a0ec-0eacc8380ad5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:17.011387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:17.030394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0473-c85b-489d-ba2d-93fe45d3b1dd None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:17.067651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d982f-4aba-4197-a0ae-33fdd699e4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:17.068444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d982f-4aba-4197-a0ae-33fdd699e4c5 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:17.068725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d982f-4aba-4197-a0ae-33fdd699e4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:17.068998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d982f-4aba-4197-a0ae-33fdd699e4c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:17.080257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d982f-4aba-4197-a0ae-33fdd699e4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:17.081703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d982f-4aba-4197-a0ae-33fdd699e4c5 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:17.086913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204cfc6-2267-4c8b-a0ec-0eacc8380ad5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-b34d982f-4aba-4197-a0ae-33fdd699e4c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:17.104732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:17.105645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:17.112001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:17.112001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:17.112001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:17.112001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:17.112001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 283/586] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:17.112001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d982f-4aba-4197-a0ae-33fdd699e4c5 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:17.115962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:17.125520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4846-f909-4cb7-b463-fd5b0d1091a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:17.126420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4846-f909-4cb7-b463-fd5b0d1091a1 None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:17.126755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4846-f909-4cb7-b463-fd5b0d1091a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:17.127043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f4846-f909-4cb7-b463-fd5b0d1091a1 None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/d039be6500e74ae3a6f30821c5c19a99/roles/72f436fe8f3041eea65efc9ea7545683` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:17.142937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f4846-f909-4cb7-b463-fd5b0d1091a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=d039be6500e74ae3a6f30821c5c19a99, role_id=72f436fe8f3041eea65efc9ea7545683)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:17.144415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f4846-f909-4cb7-b463-fd5b0d1091a1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:17.213491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d982f-4aba-4197-a0ae-33fdd699e4c5 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:17.227724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 304/587] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:33:16 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/d039be6500e74ae3a6f30821c5c19a99/roles/72f436fe8f3041eea65efc9ea7545683 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:33:17.227724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4846-f909-4cb7-b463-fd5b0d1091a1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:17.269303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20ba03-edc2-426a-b7e7-5ecb331f2fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:17.269976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20ba03-edc2-426a-b7e7-5ecb331f2fac None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:17.270255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20ba03-edc2-426a-b7e7-5ecb331f2fac None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:17.270526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20ba03-edc2-426a-b7e7-5ecb331f2fac None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:17.271685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20ba03-edc2-426a-b7e7-5ecb331f2fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:17.273292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20ba03-edc2-426a-b7e7-5ecb331f2fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:17.275088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20ba03-edc2-426a-b7e7-5ecb331f2fac None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:17.291733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:17.299487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 284/588] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:17.299487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20ba03-edc2-426a-b7e7-5ecb331f2fac None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:17.363451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f4846-f909-4cb7-b463-fd5b0d1091a1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:17.414571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34157177-330d-4635-b357-057f7f8df47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:17.415319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34157177-330d-4635-b357-057f7f8df47f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:17.415779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34157177-330d-4635-b357-057f7f8df47f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:17.416123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34157177-330d-4635-b357-057f7f8df47f None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:17.416918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34157177-330d-4635-b357-057f7f8df47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:17.417287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34157177-330d-4635-b357-057f7f8df47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:17.418738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34157177-330d-4635-b357-057f7f8df47f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:17.427670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20ba03-edc2-426a-b7e7-5ecb331f2fac None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:17.432792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 305/589] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:17.433722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34157177-330d-4635-b357-057f7f8df47f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:17.470140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0ba12-933e-4664-9603-4c1b6d7866fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:17.470732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0ba12-933e-4664-9603-4c1b6d7866fc None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:17.471013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0ba12-933e-4664-9603-4c1b6d7866fc None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:17.471288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0ba12-933e-4664-9603-4c1b6d7866fc None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:17.472025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0ba12-933e-4664-9603-4c1b6d7866fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:17.472328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0ba12-933e-4664-9603-4c1b6d7866fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:17.473767 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0ba12-933e-4664-9603-4c1b6d7866fc None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:17.490556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 285/590] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:17.492334 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0ba12-933e-4664-9603-4c1b6d7866fc None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:17.533399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:17.564593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:17.603490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34157177-330d-4635-b357-057f7f8df47f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:17.614945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0ba12-933e-4664-9603-4c1b6d7866fc None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:17.648081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706fa24-bb88-45e8-87ac-70b1f6fe5aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:17.648875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706fa24-bb88-45e8-87ac-70b1f6fe5aab None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:17.649214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706fa24-bb88-45e8-87ac-70b1f6fe5aab None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:17.649493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706fa24-bb88-45e8-87ac-70b1f6fe5aab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:17.652123 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace8777-b476-44c1-b464-f48cbbdb4210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:17.653012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace8777-b476-44c1-b464-f48cbbdb4210 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:17.653360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace8777-b476-44c1-b464-f48cbbdb4210 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:17.653707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace8777-b476-44c1-b464-f48cbbdb4210 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:17.657889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706fa24-bb88-45e8-87ac-70b1f6fe5aab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:17.659436 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706fa24-bb88-45e8-87ac-70b1f6fe5aab None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:17.663748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace8777-b476-44c1-b464-f48cbbdb4210 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:17.665272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace8777-b476-44c1-b464-f48cbbdb4210 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-0706fa24-bb88-45e8-87ac-70b1f6fe5aab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:17.675378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:17.676230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:17.677101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:17.677101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:17.677101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:17.677101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:17.677101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:17.677101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:17.677101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:17.677101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:17.677101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 306/591] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:17.677883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706fa24-bb88-45e8-87ac-70b1f6fe5aab None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-9ace8777-b476-44c1-b464-f48cbbdb4210 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:17.684317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:17.686360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:17.688291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 286/592] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Jun 17 08:33:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:17.689633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace8777-b476-44c1-b464-f48cbbdb4210 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:17.805632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:17.811441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706fa24-bb88-45e8-87ac-70b1f6fe5aab None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:17.815114 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace8777-b476-44c1-b464-f48cbbdb4210 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:17.832510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:17.852176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a97db3-5b57-4f4a-bdab-1972de110647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:17.853473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a97db3-5b57-4f4a-bdab-1972de110647 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:17.853946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a97db3-5b57-4f4a-bdab-1972de110647 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:17.854386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a97db3-5b57-4f4a-bdab-1972de110647 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:17.856854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc06128-08fd-447e-ac2f-60e68b509084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:17.861341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc06128-08fd-447e-ac2f-60e68b509084 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:17.861341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc06128-08fd-447e-ac2f-60e68b509084 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:17.861341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc06128-08fd-447e-ac2f-60e68b509084 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:17.861341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc06128-08fd-447e-ac2f-60e68b509084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:17.861341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc06128-08fd-447e-ac2f-60e68b509084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:17.861761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc06128-08fd-447e-ac2f-60e68b509084 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:17.862858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a97db3-5b57-4f4a-bdab-1972de110647 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:17.865013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a97db3-5b57-4f4a-bdab-1972de110647 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:17.880839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 287/593] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:17.880839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc06128-08fd-447e-ac2f-60e68b509084 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-01a97db3-5b57-4f4a-bdab-1972de110647 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:17.887957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:17.889586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:17.890529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:17.890529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:17.890529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:17.890529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:17.890529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:17.890529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:17.890529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:17.890529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:17.890529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:33:17.890529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:17.893212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 307/594] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:17.897943 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a97db3-5b57-4f4a-bdab-1972de110647 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:18.008117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc06128-08fd-447e-ac2f-60e68b509084 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:18.026478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a97db3-5b57-4f4a-bdab-1972de110647 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:18.058097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab146f53-c514-444b-af37-d7116d8b4ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:18.058690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab146f53-c514-444b-af37-d7116d8b4ade None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.058971 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab146f53-c514-444b-af37-d7116d8b4ade None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.059246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab146f53-c514-444b-af37-d7116d8b4ade None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:18.061304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab146f53-c514-444b-af37-d7116d8b4ade None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:18.061610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab146f53-c514-444b-af37-d7116d8b4ade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:18.063312 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab146f53-c514-444b-af37-d7116d8b4ade None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:18.066400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc79dd-f7fd-4cd7-a50d-bae3679f933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:18.067585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc79dd-f7fd-4cd7-a50d-bae3679f933f None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.068087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc79dd-f7fd-4cd7-a50d-bae3679f933f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.068560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc79dd-f7fd-4cd7-a50d-bae3679f933f None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/bd7feb1014c44c5a9b3832bad417b47c/roles/72f436fe8f3041eea65efc9ea7545683` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:18.085061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc79dd-f7fd-4cd7-a50d-bae3679f933f None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=bd7feb1014c44c5a9b3832bad417b47c, role_id=72f436fe8f3041eea65efc9ea7545683)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:18.086870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc79dd-f7fd-4cd7-a50d-bae3679f933f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:18.089363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 288/595] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Jun 17 08:33:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:18.090578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab146f53-c514-444b-af37-d7116d8b4ade None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:18.124496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:18.163537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 308/596] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:33:17 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/bd7feb1014c44c5a9b3832bad417b47c/roles/72f436fe8f3041eea65efc9ea7545683 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:33:18.165258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc79dd-f7fd-4cd7-a50d-bae3679f933f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:18.190255 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:18.214387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab146f53-c514-444b-af37-d7116d8b4ade None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:18.263389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9996c-051c-4d1d-ad1a-89a36daa7e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:18.263389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9996c-051c-4d1d-ad1a-89a36daa7e09 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.263389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9996c-051c-4d1d-ad1a-89a36daa7e09 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.263389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9996c-051c-4d1d-ad1a-89a36daa7e09 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:18.263912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9996c-051c-4d1d-ad1a-89a36daa7e09 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:18.263912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9996c-051c-4d1d-ad1a-89a36daa7e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:18.265025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9996c-051c-4d1d-ad1a-89a36daa7e09 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:18.287743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 289/597] 10.222.0.78 () {56 vars in 1139 bytes} [Fri Jun 17 08:33:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:18.298399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9996c-051c-4d1d-ad1a-89a36daa7e09 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:18.371331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc79dd-f7fd-4cd7-a50d-bae3679f933f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:18.420556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604322e7-4f9e-4a69-9f58-28164ff897c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:18.421379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604322e7-4f9e-4a69-9f58-28164ff897c3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.421664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604322e7-4f9e-4a69-9f58-28164ff897c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.421945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604322e7-4f9e-4a69-9f58-28164ff897c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:18.433398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604322e7-4f9e-4a69-9f58-28164ff897c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:18.434867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604322e7-4f9e-4a69-9f58-28164ff897c3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-604322e7-4f9e-4a69-9f58-28164ff897c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:18.459431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:18.460345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:18.461207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:18.461207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:18.461207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:18.461207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:18.461207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 309/598] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:18.472387 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604322e7-4f9e-4a69-9f58-28164ff897c3 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:18.472990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:18.492807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9996c-051c-4d1d-ad1a-89a36daa7e09 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:18.553091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03abee7-9b10-474a-ae3e-30e5a70d98bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:18.553921 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abee7-9b10-474a-ae3e-30e5a70d98bf None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.554202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abee7-9b10-474a-ae3e-30e5a70d98bf None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.554476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abee7-9b10-474a-ae3e-30e5a70d98bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:18.579809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03abee7-9b10-474a-ae3e-30e5a70d98bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:18.581303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03abee7-9b10-474a-ae3e-30e5a70d98bf None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:18.588316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-b03abee7-9b10-474a-ae3e-30e5a70d98bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:18.632422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:18.633521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:18.634606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:18.634606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:18.634606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:18.634606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:18.634872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604322e7-4f9e-4a69-9f58-28164ff897c3 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:18.636329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 290/599] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:18.637766 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d7368-4286-4ddc-97b3-4756891ab784 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.638220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d7368-4286-4ddc-97b3-4756891ab784 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.638706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d7368-4286-4ddc-97b3-4756891ab784 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:18.640814 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 291/600] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:18.643055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d7368-4286-4ddc-97b3-4756891ab784 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:18.679650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05336d-9625-4e83-b67d-da05d8d498e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:18.680807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05336d-9625-4e83-b67d-da05d8d498e3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.681194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05336d-9625-4e83-b67d-da05d8d498e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.681806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05336d-9625-4e83-b67d-da05d8d498e3 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:18.682638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05336d-9625-4e83-b67d-da05d8d498e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:18.683217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05336d-9625-4e83-b67d-da05d8d498e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:18.685282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05336d-9625-4e83-b67d-da05d8d498e3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:18.700726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 310/601] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:18.703563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099b69-2367-4730-adb1-56e63f351bed None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.703958 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099b69-2367-4730-adb1-56e63f351bed None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.704339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4099b69-2367-4730-adb1-56e63f351bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:18.724646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a4099b69-2367-4730-adb1-56e63f351bed None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:18.726242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a4099b69-2367-4730-adb1-56e63f351bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:18.771108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d7368-4286-4ddc-97b3-4756891ab784 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:18.804535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 311/602] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:18.806034 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4099b69-2367-4730-adb1-56e63f351bed None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:18.807788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df462448-38d6-4909-ab45-0494d33f4227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:18.808676 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df462448-38d6-4909-ab45-0494d33f4227 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.809101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df462448-38d6-4909-ab45-0494d33f4227 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.809544 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df462448-38d6-4909-ab45-0494d33f4227 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:18.810952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df462448-38d6-4909-ab45-0494d33f4227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:18.811551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df462448-38d6-4909-ab45-0494d33f4227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:18.813053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df462448-38d6-4909-ab45-0494d33f4227 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:18.839529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 292/603] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:18.840632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df462448-38d6-4909-ab45-0494d33f4227 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:18.845858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:18.859971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:18.912175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4099b69-2367-4730-adb1-56e63f351bed None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:18.947018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc4dc2-c26b-4453-8534-bc939175ec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:18.947875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc4dc2-c26b-4453-8534-bc939175ec8c None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.948163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc4dc2-c26b-4453-8534-bc939175ec8c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.948450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc4dc2-c26b-4453-8534-bc939175ec8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:18.952801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df462448-38d6-4909-ab45-0494d33f4227 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:18.956390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc4dc2-c26b-4453-8534-bc939175ec8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:18.957851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc4dc2-c26b-4453-8534-bc939175ec8c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-c8fc4dc2-c26b-4453-8534-bc939175ec8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:18.972493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:18.973388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:18.974259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:18.974259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:18.974259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:18.974259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:18.974259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:18.974259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:18.974259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:18.974259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:18.974259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 312/604] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:18.975272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc4dc2-c26b-4453-8534-bc939175ec8c None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:18.991015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50315b-5944-4062-9f45-5cfd32bd3497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:18.991949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50315b-5944-4062-9f45-5cfd32bd3497 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:18.992283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50315b-5944-4062-9f45-5cfd32bd3497 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:18.992564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50315b-5944-4062-9f45-5cfd32bd3497 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:19.006826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50315b-5944-4062-9f45-5cfd32bd3497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-6a50315b-5944-4062-9f45-5cfd32bd3497 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:19.017824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:19.018784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:19.019629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:19.023482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 293/605] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:19.024336 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50315b-5944-4062-9f45-5cfd32bd3497 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:19.091022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:19.104743 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc4dc2-c26b-4453-8534-bc939175ec8c None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:19.116005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:19.132534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50315b-5944-4062-9f45-5cfd32bd3497 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:19.142641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87ac57-5cec-48a8-ae07-a37b9178a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:19.144088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ac57-5cec-48a8-ae07-a37b9178a538 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:19.144909 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ac57-5cec-48a8-ae07-a37b9178a538 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:19.145376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87ac57-5cec-48a8-ae07-a37b9178a538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:19.156011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87ac57-5cec-48a8-ae07-a37b9178a538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:19.159457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87ac57-5cec-48a8-ae07-a37b9178a538 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:19.170435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546a5b5-8050-4573-9488-67aa15fda517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:19.171248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546a5b5-8050-4573-9488-67aa15fda517 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:19.171702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546a5b5-8050-4573-9488-67aa15fda517 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:19.172077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546a5b5-8050-4573-9488-67aa15fda517 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:19.172965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546a5b5-8050-4573-9488-67aa15fda517 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:19.173375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546a5b5-8050-4573-9488-67aa15fda517 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:19.174892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546a5b5-8050-4573-9488-67aa15fda517 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-3d87ac57-5cec-48a8-ae07-a37b9178a538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:19.178869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:19.180289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:19.181392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:19.181392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:19.181392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:19.181392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:19.181392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:19.181392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:19.181392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:19.181392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:19.183221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 313/606] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:19.184214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87ac57-5cec-48a8-ae07-a37b9178a538 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:19.190800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 294/607] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:19.191803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546a5b5-8050-4573-9488-67aa15fda517 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:19.292807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546a5b5-8050-4573-9488-67aa15fda517 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:19.318193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87ac57-5cec-48a8-ae07-a37b9178a538 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:19.325511 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:19.329813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2adf7-e3c9-4ab0-b574-08e8063758b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:19.330545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2adf7-e3c9-4ab0-b574-08e8063758b5 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:19.330928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2adf7-e3c9-4ab0-b574-08e8063758b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:19.331302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2adf7-e3c9-4ab0-b574-08e8063758b5 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:19.332440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2adf7-e3c9-4ab0-b574-08e8063758b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:19.332594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2adf7-e3c9-4ab0-b574-08e8063758b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:19.334188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2adf7-e3c9-4ab0-b574-08e8063758b5 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:19.354320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 295/608] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:19.354320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2adf7-e3c9-4ab0-b574-08e8063758b5 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:19.374651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a451e-412b-4981-a4aa-5a2ca62ad82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:19.375707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a451e-412b-4981-a4aa-5a2ca62ad82b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:19.376774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a451e-412b-4981-a4aa-5a2ca62ad82b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:19.377242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a451e-412b-4981-a4aa-5a2ca62ad82b None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:19.378482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a451e-412b-4981-a4aa-5a2ca62ad82b None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:19.378974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a451e-412b-4981-a4aa-5a2ca62ad82b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:19.381520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a451e-412b-4981-a4aa-5a2ca62ad82b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:19.399294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 314/609] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:19.400562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a451e-412b-4981-a4aa-5a2ca62ad82b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:19.451965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:19.488167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2adf7-e3c9-4ab0-b574-08e8063758b5 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:19.533061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a451e-412b-4981-a4aa-5a2ca62ad82b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:19.535175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea6bbc-3ae3-4371-8e2b-8e4c5c2ee44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:19.536105 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6bbc-3ae3-4371-8e2b-8e4c5c2ee44c None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:19.536395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6bbc-3ae3-4371-8e2b-8e4c5c2ee44c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:19.536672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea6bbc-3ae3-4371-8e2b-8e4c5c2ee44c None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/6aa3618089794b938018ff2666afebe3/roles/72f436fe8f3041eea65efc9ea7545683` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:19.552518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea6bbc-3ae3-4371-8e2b-8e4c5c2ee44c None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=6aa3618089794b938018ff2666afebe3, role_id=72f436fe8f3041eea65efc9ea7545683)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:19.553977 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea6bbc-3ae3-4371-8e2b-8e4c5c2ee44c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:19.569399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc38fe-ba3a-4ab0-98c6-77b82589a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:19.570494 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc38fe-ba3a-4ab0-98c6-77b82589a765 None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:19.570770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc38fe-ba3a-4ab0-98c6-77b82589a765 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:19.571042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc38fe-ba3a-4ab0-98c6-77b82589a765 None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/024e0e53cfdb42e88dfdfde7a79e8c75/roles/72f436fe8f3041eea65efc9ea7545683` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:19.586658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc38fe-ba3a-4ab0-98c6-77b82589a765 None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=024e0e53cfdb42e88dfdfde7a79e8c75, role_id=72f436fe8f3041eea65efc9ea7545683)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:19.588111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc38fe-ba3a-4ab0-98c6-77b82589a765 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:19.659048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 296/610] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:33:19 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/6aa3618089794b938018ff2666afebe3/roles/72f436fe8f3041eea65efc9ea7545683 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:33:19.659895 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea6bbc-3ae3-4371-8e2b-8e4c5c2ee44c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:19.675534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 315/611] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:33:19 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/024e0e53cfdb42e88dfdfde7a79e8c75/roles/72f436fe8f3041eea65efc9ea7545683 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:33:19.676991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64277-4f3e-47c0-a998-ec1ac1da1314 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:19.677276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64277-4f3e-47c0-a998-ec1ac1da1314 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:19.677541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64277-4f3e-47c0-a998-ec1ac1da1314 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:19.683276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 316/612] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:19.684727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d797e7-380d-449b-bd7b-5434af5a13e0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:19.685011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d797e7-380d-449b-bd7b-5434af5a13e0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:19.685867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d797e7-380d-449b-bd7b-5434af5a13e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:19.704607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-26d797e7-380d-449b-bd7b-5434af5a13e0 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:19.705744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-26d797e7-380d-449b-bd7b-5434af5a13e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:19.712540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:19.800053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea6bbc-3ae3-4371-8e2b-8e4c5c2ee44c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:19.806999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 317/613] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:19.840885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d797e7-380d-449b-bd7b-5434af5a13e0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:19.859338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:19.897310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0843d01-c447-496c-8a52-3da34f640a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:19.898146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0843d01-c447-496c-8a52-3da34f640a90 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:19.898434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0843d01-c447-496c-8a52-3da34f640a90 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:19.898719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0843d01-c447-496c-8a52-3da34f640a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:19.924104 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0843d01-c447-496c-8a52-3da34f640a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:19.925727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0843d01-c447-496c-8a52-3da34f640a90 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-c0843d01-c447-496c-8a52-3da34f640a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:19.954513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:19.955539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:19.956451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:19.956451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:19.956451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:19.956451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:19.956451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 297/614] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:19.962086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0843d01-c447-496c-8a52-3da34f640a90 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:19.980017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d797e7-380d-449b-bd7b-5434af5a13e0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:20.023528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf4b47-b3c7-4cfb-94aa-897f1f834b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:20.025131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf4b47-b3c7-4cfb-94aa-897f1f834b99 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:20.025623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf4b47-b3c7-4cfb-94aa-897f1f834b99 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:20.026359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf4b47-b3c7-4cfb-94aa-897f1f834b99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:20.040836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf4b47-b3c7-4cfb-94aa-897f1f834b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-12bf4b47-b3c7-4cfb-94aa-897f1f834b99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:20.051234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:20.052240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:20.053074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:20.056241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 318/615] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:20.062874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf4b47-b3c7-4cfb-94aa-897f1f834b99 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:20.067394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:20.084607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0843d01-c447-496c-8a52-3da34f640a90 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:20.124448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94278fa1-0dec-46af-9b5a-a88c412d58af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:20.126411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94278fa1-0dec-46af-9b5a-a88c412d58af None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:20.127148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94278fa1-0dec-46af-9b5a-a88c412d58af None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:20.128762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94278fa1-0dec-46af-9b5a-a88c412d58af None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:20.129719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94278fa1-0dec-46af-9b5a-a88c412d58af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:20.130328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94278fa1-0dec-46af-9b5a-a88c412d58af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:20.132960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94278fa1-0dec-46af-9b5a-a88c412d58af None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:20.160237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 298/616] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:20.161517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94278fa1-0dec-46af-9b5a-a88c412d58af None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:20.269924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:20.289223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94278fa1-0dec-46af-9b5a-a88c412d58af None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:20.328643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf4b47-b3c7-4cfb-94aa-897f1f834b99 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:20.339135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6beb4e-262c-4646-8355-df20996a31c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:20.339963 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6beb4e-262c-4646-8355-df20996a31c2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:20.340244 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6beb4e-262c-4646-8355-df20996a31c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:20.340518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6beb4e-262c-4646-8355-df20996a31c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:20.353399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6beb4e-262c-4646-8355-df20996a31c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:20.354852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6beb4e-262c-4646-8355-df20996a31c2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-ed6beb4e-262c-4646-8355-df20996a31c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:20.382624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:20.383931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:20.384888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 299/617] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:20.392308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6beb4e-262c-4646-8355-df20996a31c2 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:20.397287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d4915-25aa-4214-b7f3-5edca165cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:20.398193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d4915-25aa-4214-b7f3-5edca165cb93 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:20.402750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d4915-25aa-4214-b7f3-5edca165cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:20.402750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d4915-25aa-4214-b7f3-5edca165cb93 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:20.402750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d4915-25aa-4214-b7f3-5edca165cb93 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:20.402750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d4915-25aa-4214-b7f3-5edca165cb93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:20.402750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d4915-25aa-4214-b7f3-5edca165cb93 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:20.408773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:20.415681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 319/618] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:20.417340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d4915-25aa-4214-b7f3-5edca165cb93 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:20.537634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d4915-25aa-4214-b7f3-5edca165cb93 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:20.573865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226115a1-0d1e-476a-8724-ed4b4b4cbad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:20.575333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226115a1-0d1e-476a-8724-ed4b4b4cbad1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:20.575845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226115a1-0d1e-476a-8724-ed4b4b4cbad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:20.576933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226115a1-0d1e-476a-8724-ed4b4b4cbad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:20.579187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:20.589396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226115a1-0d1e-476a-8724-ed4b4b4cbad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:20.591392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226115a1-0d1e-476a-8724-ed4b4b4cbad1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-226115a1-0d1e-476a-8724-ed4b4b4cbad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:20.610229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:20.611196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:20.612557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:20.612557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:20.612557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:20.612557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:20.614655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 320/619] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:20.621729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226115a1-0d1e-476a-8724-ed4b4b4cbad1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:20.625855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6beb4e-262c-4646-8355-df20996a31c2 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:20.705875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458bd5c-288b-4a86-8b90-dd6013b92c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:20.706550 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458bd5c-288b-4a86-8b90-dd6013b92c4a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:20.706838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458bd5c-288b-4a86-8b90-dd6013b92c4a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:20.707118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458bd5c-288b-4a86-8b90-dd6013b92c4a None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:20.708580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458bd5c-288b-4a86-8b90-dd6013b92c4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:20.708900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458bd5c-288b-4a86-8b90-dd6013b92c4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:20.710884 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458bd5c-288b-4a86-8b90-dd6013b92c4a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:20.735007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226115a1-0d1e-476a-8724-ed4b4b4cbad1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:20.739429 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 300/620] 10.222.0.78 () {56 vars in 1135 bytes} [Fri Jun 17 08:33:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:20.740991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1320449-7e12-4cd3-8892-5ae0dee83553 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:20.741279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1320449-7e12-4cd3-8892-5ae0dee83553 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:20.741553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1320449-7e12-4cd3-8892-5ae0dee83553 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:20.742930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 301/621] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:20.743507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1320449-7e12-4cd3-8892-5ae0dee83553 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:20.784954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df5078-69e4-4a43-b828-6d1ff62c29f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:20.785536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df5078-69e4-4a43-b828-6d1ff62c29f9 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:20.785820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df5078-69e4-4a43-b828-6d1ff62c29f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:20.786096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df5078-69e4-4a43-b828-6d1ff62c29f9 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:20.786823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df5078-69e4-4a43-b828-6d1ff62c29f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:20.787133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df5078-69e4-4a43-b828-6d1ff62c29f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:20.788601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df5078-69e4-4a43-b828-6d1ff62c29f9 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:20.801532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 321/622] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:20.802760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797454d5-bde6-4585-aec6-b60d6f6b1f0f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:20.803046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797454d5-bde6-4585-aec6-b60d6f6b1f0f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:20.803321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797454d5-bde6-4585-aec6-b60d6f6b1f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:20.822037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:20.825917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-797454d5-bde6-4585-aec6-b60d6f6b1f0f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:20.828225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-797454d5-bde6-4585-aec6-b60d6f6b1f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:20.876501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:20.880868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1320449-7e12-4cd3-8892-5ae0dee83553 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:20.902736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 322/623] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:20.903823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797454d5-bde6-4585-aec6-b60d6f6b1f0f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:20.927269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0155c-c67e-44a1-8535-4980830a303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:20.928937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0155c-c67e-44a1-8535-4980830a303e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:20.929462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0155c-c67e-44a1-8535-4980830a303e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:20.930187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0155c-c67e-44a1-8535-4980830a303e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:20.943767 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0155c-c67e-44a1-8535-4980830a303e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:20.945557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0155c-c67e-44a1-8535-4980830a303e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-b8d0155c-c67e-44a1-8535-4980830a303e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:20.963679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:20.964589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:20.965467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:20.965467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:20.965467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:20.965467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:20.972769 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 302/624] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:20.973788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0155c-c67e-44a1-8535-4980830a303e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.011335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797454d5-bde6-4585-aec6-b60d6f6b1f0f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:21.050694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82825e-4b66-491c-8b75-405f0cc6a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:21.051497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82825e-4b66-491c-8b75-405f0cc6a06b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:21.051759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82825e-4b66-491c-8b75-405f0cc6a06b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:21.052036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82825e-4b66-491c-8b75-405f0cc6a06b None admin] PATH_INFO: `/v3/users/glance` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:21.059689 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82825e-4b66-491c-8b75-405f0cc6a06b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:21.061325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82825e-4b66-491c-8b75-405f0cc6a06b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-5b82825e-4b66-491c-8b75-405f0cc6a06b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:21.077772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:21.078801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 323/625] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:21.080238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82825e-4b66-491c-8b75-405f0cc6a06b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.090903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0155c-c67e-44a1-8535-4980830a303e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:21.106401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:21.121187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:21.128067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e813e-ead3-4599-8308-1b51b8da20e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:21.128959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e813e-ead3-4599-8308-1b51b8da20e1 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:21.129315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e813e-ead3-4599-8308-1b51b8da20e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:21.129661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e813e-ead3-4599-8308-1b51b8da20e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:21.141347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e813e-ead3-4599-8308-1b51b8da20e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-292e813e-ead3-4599-8308-1b51b8da20e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:21.149774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:21.150906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:21.151948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:21.159641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 303/626] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:21.160661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e813e-ead3-4599-8308-1b51b8da20e1 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.199485 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82825e-4b66-491c-8b75-405f0cc6a06b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:21.239249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af984101-5bbc-49b3-a7a8-39a723167e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:21.240235 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af984101-5bbc-49b3-a7a8-39a723167e8f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:21.240741 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af984101-5bbc-49b3-a7a8-39a723167e8f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:21.241216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af984101-5bbc-49b3-a7a8-39a723167e8f None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:21.242075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af984101-5bbc-49b3-a7a8-39a723167e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:21.242535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af984101-5bbc-49b3-a7a8-39a723167e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:21.244224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af984101-5bbc-49b3-a7a8-39a723167e8f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:21.257341 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 324/627] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:21.258506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af984101-5bbc-49b3-a7a8-39a723167e8f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.271456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e813e-ead3-4599-8308-1b51b8da20e1 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:21.306927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ca0a7-53cc-4d3e-a094-295e01666126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:21.307552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ca0a7-53cc-4d3e-a094-295e01666126 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:21.307838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ca0a7-53cc-4d3e-a094-295e01666126 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:21.308118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ca0a7-53cc-4d3e-a094-295e01666126 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:21.308954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ca0a7-53cc-4d3e-a094-295e01666126 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:21.309264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ca0a7-53cc-4d3e-a094-295e01666126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:21.310923 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ca0a7-53cc-4d3e-a094-295e01666126 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:21.329173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 304/628] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Jun 17 08:33:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:21.330121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ca0a7-53cc-4d3e-a094-295e01666126 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.362003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:21.365372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:21.372077 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af984101-5bbc-49b3-a7a8-39a723167e8f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:21.407088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa627f3-90ca-4391-960d-5d45a1190b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:21.408127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa627f3-90ca-4391-960d-5d45a1190b10 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:21.408632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa627f3-90ca-4391-960d-5d45a1190b10 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:21.409151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa627f3-90ca-4391-960d-5d45a1190b10 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:21.410133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa627f3-90ca-4391-960d-5d45a1190b10 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:21.410634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa627f3-90ca-4391-960d-5d45a1190b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:21.412307 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa627f3-90ca-4391-960d-5d45a1190b10 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:21.423456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 325/629] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:21.424630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa627f3-90ca-4391-960d-5d45a1190b10 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.443037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ca0a7-53cc-4d3e-a094-295e01666126 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:21.495392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5f11-865d-4e9d-9816-7b8d425612e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:21.496224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5f11-865d-4e9d-9816-7b8d425612e2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:21.496505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5f11-865d-4e9d-9816-7b8d425612e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:21.496784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e5f11-865d-4e9d-9816-7b8d425612e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:21.505164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5f11-865d-4e9d-9816-7b8d425612e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:21.506776 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e5f11-865d-4e9d-9816-7b8d425612e2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-154e5f11-865d-4e9d-9816-7b8d425612e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:21.521261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:21.522185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:21.523057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:21.523057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:21.523057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:21.523057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:21.523057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:21.523057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:21.523057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:21.523057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:21.527179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 305/630] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:21.528054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5f11-865d-4e9d-9816-7b8d425612e2 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.560015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa627f3-90ca-4391-960d-5d45a1190b10 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:21.598797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9b74c-957a-4946-a3bc-cf0ccb620ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:21.599975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9b74c-957a-4946-a3bc-cf0ccb620ed4 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:21.600493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9b74c-957a-4946-a3bc-cf0ccb620ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:21.600963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9b74c-957a-4946-a3bc-cf0ccb620ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:21.625596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:21.634401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:21.634775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e5f11-865d-4e9d-9816-7b8d425612e2 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:21.670809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affe0a2-7b33-4466-bab8-5119efeb1d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:21.671640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affe0a2-7b33-4466-bab8-5119efeb1d65 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:21.671925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affe0a2-7b33-4466-bab8-5119efeb1d65 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:21.672206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affe0a2-7b33-4466-bab8-5119efeb1d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:21.680314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9b74c-957a-4946-a3bc-cf0ccb620ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:21.682105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9b74c-957a-4946-a3bc-cf0ccb620ed4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:21.684576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affe0a2-7b33-4466-bab8-5119efeb1d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:21.686560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affe0a2-7b33-4466-bab8-5119efeb1d65 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-5affe0a2-7b33-4466-bab8-5119efeb1d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:21.706082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:21.707003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:21.707926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:21.707926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:21.707926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:21.707926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:21.711476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 306/631] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:21.712418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affe0a2-7b33-4466-bab8-5119efeb1d65 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.792733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 326/632] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:33:21.793928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9b74c-957a-4946-a3bc-cf0ccb620ed4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.819639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affe0a2-7b33-4466-bab8-5119efeb1d65 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:21.856836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec48318-a501-403c-b642-d1561b7589d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:21.858047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48318-a501-403c-b642-d1561b7589d0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:21.858350 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48318-a501-403c-b642-d1561b7589d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:21.858607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec48318-a501-403c-b642-d1561b7589d0 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:21.859436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec48318-a501-403c-b642-d1561b7589d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:21.859751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec48318-a501-403c-b642-d1561b7589d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:21.860498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:21.861574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec48318-a501-403c-b642-d1561b7589d0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:21.874952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 307/633] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:21.879647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec48318-a501-403c-b642-d1561b7589d0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.883455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:21.905519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9b74c-957a-4946-a3bc-cf0ccb620ed4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:21.941237 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99050607-85d2-47ec-9a33-45c6cea5f6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:21.942296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99050607-85d2-47ec-9a33-45c6cea5f6c0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:21.942772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99050607-85d2-47ec-9a33-45c6cea5f6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:21.943260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99050607-85d2-47ec-9a33-45c6cea5f6c0 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:21.944207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99050607-85d2-47ec-9a33-45c6cea5f6c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:21.944709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99050607-85d2-47ec-9a33-45c6cea5f6c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:21.946262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99050607-85d2-47ec-9a33-45c6cea5f6c0 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:21.959845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 327/634] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:21.960952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99050607-85d2-47ec-9a33-45c6cea5f6c0 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:21.996116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec48318-a501-403c-b642-d1561b7589d0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:22.034806 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff37a4-d989-45c6-a002-ffc9a1c1861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:22.035848 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff37a4-d989-45c6-a002-ffc9a1c1861d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.036091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff37a4-d989-45c6-a002-ffc9a1c1861d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.036377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff37a4-d989-45c6-a002-ffc9a1c1861d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.049270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff37a4-d989-45c6-a002-ffc9a1c1861d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:22.050774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff37a4-d989-45c6-a002-ffc9a1c1861d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-97ff37a4-d989-45c6-a002-ffc9a1c1861d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:22.071654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:22.072593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:22.073470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:22.073470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:22.073470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:22.073470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:22.073470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 308/635] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:22.074222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff37a4-d989-45c6-a002-ffc9a1c1861d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:22.087142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99050607-85d2-47ec-9a33-45c6cea5f6c0 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:22.107816 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:22.126269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07773574-d687-4e71-baf8-07008ebc644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:22.127297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773574-d687-4e71-baf8-07008ebc644f None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.127625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773574-d687-4e71-baf8-07008ebc644f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.128104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773574-d687-4e71-baf8-07008ebc644f None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/46e2b769ba9b46778c96b2a04d45612d/roles/72f436fe8f3041eea65efc9ea7545683` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.136716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:22.143317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07773574-d687-4e71-baf8-07008ebc644f None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=46e2b769ba9b46778c96b2a04d45612d, role_id=72f436fe8f3041eea65efc9ea7545683)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:22.144807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07773574-d687-4e71-baf8-07008ebc644f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:22.181252 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff37a4-d989-45c6-a002-ffc9a1c1861d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:22.210204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 328/636] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:33:21 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/46e2b769ba9b46778c96b2a04d45612d/roles/72f436fe8f3041eea65efc9ea7545683 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:33:22.211105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07773574-d687-4e71-baf8-07008ebc644f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:22.218841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4316bb0-63aa-4eef-afd9-009b747cbfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:22.220781 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316bb0-63aa-4eef-afd9-009b747cbfcf None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.220781 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316bb0-63aa-4eef-afd9-009b747cbfcf None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.221159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316bb0-63aa-4eef-afd9-009b747cbfcf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.233153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4316bb0-63aa-4eef-afd9-009b747cbfcf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:22.234662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4316bb0-63aa-4eef-afd9-009b747cbfcf None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-e4316bb0-63aa-4eef-afd9-009b747cbfcf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:22.250892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:22.251995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:22.253031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 309/637] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:22.253628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a135-f749-4382-83b4-8c0d087b6823 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.253708 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a135-f749-4382-83b4-8c0d087b6823 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.254319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a135-f749-4382-83b4-8c0d087b6823 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.255401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 310/638] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:22.260617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f885e-584c-4cf7-b520-c70ff7f6e416 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.260905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f885e-584c-4cf7-b520-c70ff7f6e416 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.261188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f885e-584c-4cf7-b520-c70ff7f6e416 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.262585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 311/639] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:22.264213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f885e-584c-4cf7-b520-c70ff7f6e416 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:22.343094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07773574-d687-4e71-baf8-07008ebc644f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:22.385293 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2ee31-f5de-49ce-814b-ed6fab2a9047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:22.386133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2ee31-f5de-49ce-814b-ed6fab2a9047 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.386418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2ee31-f5de-49ce-814b-ed6fab2a9047 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.386691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2ee31-f5de-49ce-814b-ed6fab2a9047 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.387490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2ee31-f5de-49ce-814b-ed6fab2a9047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:22.387797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2ee31-f5de-49ce-814b-ed6fab2a9047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:22.389856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2ee31-f5de-49ce-814b-ed6fab2a9047 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:22.395770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f885e-584c-4cf7-b520-c70ff7f6e416 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:22.401531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 329/640] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:22.406155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c3d2a-3751-4e20-b9c0-f6698d384b64 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.406155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c3d2a-3751-4e20-b9c0-f6698d384b64 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.406155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c3d2a-3751-4e20-b9c0-f6698d384b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.419434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:22.420819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f54c3d2a-3751-4e20-b9c0-f6698d384b64 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:22.422029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f54c3d2a-3751-4e20-b9c0-f6698d384b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:22.439936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d16f7b-8320-4a2a-ad22-0b472c3b733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:22.455533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d16f7b-8320-4a2a-ad22-0b472c3b733d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.455533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d16f7b-8320-4a2a-ad22-0b472c3b733d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.455533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d16f7b-8320-4a2a-ad22-0b472c3b733d None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.455533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d16f7b-8320-4a2a-ad22-0b472c3b733d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:22.455533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d16f7b-8320-4a2a-ad22-0b472c3b733d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:22.455533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d16f7b-8320-4a2a-ad22-0b472c3b733d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:22.456500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:22.467439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 312/641] 10.222.0.78 () {56 vars in 1137 bytes} [Fri Jun 17 08:33:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:22.467439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30c08a-d804-4d39-b534-dcc160e19b63 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.467439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30c08a-d804-4d39-b534-dcc160e19b63 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.467439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30c08a-d804-4d39-b534-dcc160e19b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.483635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-4b30c08a-d804-4d39-b534-dcc160e19b63 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:22.484820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4b30c08a-d804-4d39-b534-dcc160e19b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:22.507178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 330/642] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:22.508297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c3d2a-3751-4e20-b9c0-f6698d384b64 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:22.579373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 313/643] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:22.579373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30c08a-d804-4d39-b534-dcc160e19b63 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:22.634961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c3d2a-3751-4e20-b9c0-f6698d384b64 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:22.679473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb1ab-ff99-41d1-9a20-619601091c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:22.679473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb1ab-ff99-41d1-9a20-619601091c20 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.679473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb1ab-ff99-41d1-9a20-619601091c20 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.679842 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb1ab-ff99-41d1-9a20-619601091c20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.686117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30c08a-d804-4d39-b534-dcc160e19b63 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:22.689147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb1ab-ff99-41d1-9a20-619601091c20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:22.689604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:22.690676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb1ab-ff99-41d1-9a20-619601091c20 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-3fdbb1ab-ff99-41d1-9a20-619601091c20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:22.705569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:22.706771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:22.712695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:22.712695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:22.712695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:22.712695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:22.712695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:22.712695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:22.712695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:22.712695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:22.712695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 331/644] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:22.712695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb1ab-ff99-41d1-9a20-619601091c20 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:22.726240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392c36-4911-4d5a-a5df-cb003846ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:22.727433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392c36-4911-4d5a-a5df-cb003846ab03 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.727672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392c36-4911-4d5a-a5df-cb003846ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.728027 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392c36-4911-4d5a-a5df-cb003846ab03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.734454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:22.806536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392c36-4911-4d5a-a5df-cb003846ab03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:22.808023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392c36-4911-4d5a-a5df-cb003846ab03 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:22.824697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb1ab-ff99-41d1-9a20-619601091c20 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:22.863804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26625b57-a216-4cec-a934-be55b1d11c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:22.864596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26625b57-a216-4cec-a934-be55b1d11c27 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:22.864882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26625b57-a216-4cec-a934-be55b1d11c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:22.865156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26625b57-a216-4cec-a934-be55b1d11c27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:22.876624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26625b57-a216-4cec-a934-be55b1d11c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-26625b57-a216-4cec-a934-be55b1d11c27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:22.884315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:22.885297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 332/645] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:22.886864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26625b57-a216-4cec-a934-be55b1d11c27 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:22.916742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 314/646] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:33:22.917406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392c36-4911-4d5a-a5df-cb003846ab03 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:22.921523 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:22.973596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:22.998626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26625b57-a216-4cec-a934-be55b1d11c27 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.033147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392c36-4911-4d5a-a5df-cb003846ab03 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.037237 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c26fe-5e57-401b-bb1e-c583b9d0eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:23.038035 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c26fe-5e57-401b-bb1e-c583b9d0eb57 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:23.038321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c26fe-5e57-401b-bb1e-c583b9d0eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:23.038603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c26fe-5e57-401b-bb1e-c583b9d0eb57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:23.048773 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c26fe-5e57-401b-bb1e-c583b9d0eb57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-855c26fe-5e57-401b-bb1e-c583b9d0eb57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:23.056572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:23.057696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 333/647] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:23.058878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c26fe-5e57-401b-bb1e-c583b9d0eb57 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:23.076948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff44689-b122-4b2b-8693-584b343cf3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:23.077677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff44689-b122-4b2b-8693-584b343cf3f3 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:23.077960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff44689-b122-4b2b-8693-584b343cf3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:23.078228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff44689-b122-4b2b-8693-584b343cf3f3 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:23.079010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff44689-b122-4b2b-8693-584b343cf3f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:23.079319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff44689-b122-4b2b-8693-584b343cf3f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:23.080823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff44689-b122-4b2b-8693-584b343cf3f3 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:23.097592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 315/648] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:23.097592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff44689-b122-4b2b-8693-584b343cf3f3 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:23.162402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:23.174301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c26fe-5e57-401b-bb1e-c583b9d0eb57 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.212656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff44689-b122-4b2b-8693-584b343cf3f3 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.215527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40675cd-04ed-4a70-9969-c46bc21b0c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:23.216206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40675cd-04ed-4a70-9969-c46bc21b0c31 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:23.216548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40675cd-04ed-4a70-9969-c46bc21b0c31 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:23.216988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40675cd-04ed-4a70-9969-c46bc21b0c31 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:23.218055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40675cd-04ed-4a70-9969-c46bc21b0c31 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:23.218371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40675cd-04ed-4a70-9969-c46bc21b0c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:23.219795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40675cd-04ed-4a70-9969-c46bc21b0c31 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:23.225702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:23.234200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 334/649] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:23.234200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40675cd-04ed-4a70-9969-c46bc21b0c31 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:23.251844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7437ace-9055-45c2-94c0-0bc4233fc048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:23.252645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7437ace-9055-45c2-94c0-0bc4233fc048 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:23.252932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7437ace-9055-45c2-94c0-0bc4233fc048 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:23.253206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7437ace-9055-45c2-94c0-0bc4233fc048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:23.264780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7437ace-9055-45c2-94c0-0bc4233fc048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:23.266219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7437ace-9055-45c2-94c0-0bc4233fc048 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-d7437ace-9055-45c2-94c0-0bc4233fc048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:23.283461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:23.284409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:23.285304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:23.285304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:23.285304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:23.285304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:23.285304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 316/650] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:23.286424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7437ace-9055-45c2-94c0-0bc4233fc048 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:23.351005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40675cd-04ed-4a70-9969-c46bc21b0c31 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.389578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe1c5-bf03-4ffc-8cca-d58e79ff43d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:23.390235 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe1c5-bf03-4ffc-8cca-d58e79ff43d1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:23.390507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe1c5-bf03-4ffc-8cca-d58e79ff43d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:23.390788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe1c5-bf03-4ffc-8cca-d58e79ff43d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:23.391706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe1c5-bf03-4ffc-8cca-d58e79ff43d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:23.391899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe1c5-bf03-4ffc-8cca-d58e79ff43d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:23.393427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe1c5-bf03-4ffc-8cca-d58e79ff43d1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:23.394774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7437ace-9055-45c2-94c0-0bc4233fc048 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.402421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 335/651] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:23.403522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe1c5-bf03-4ffc-8cca-d58e79ff43d1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:23.414991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:23.433128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067949d-5ef0-43b5-a55c-999d01ad7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:23.434296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067949d-5ef0-43b5-a55c-999d01ad7d50 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:23.434578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067949d-5ef0-43b5-a55c-999d01ad7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:23.434854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067949d-5ef0-43b5-a55c-999d01ad7d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:23.436357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067949d-5ef0-43b5-a55c-999d01ad7d50 None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=d039be6500e74ae3a6f30821c5c19a99) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:23.436672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067949d-5ef0-43b5-a55c-999d01ad7d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:23.438100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067949d-5ef0-43b5-a55c-999d01ad7d50 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:23.451750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 317/652] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:23 2022] GET /identity/v3/role_assignments?user.id=d039be6500e74ae3a6f30821c5c19a99&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:23.453029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067949d-5ef0-43b5-a55c-999d01ad7d50 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:23.494998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:23.548052 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe1c5-bf03-4ffc-8cca-d58e79ff43d1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.593719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b5ab4-e6c1-44a4-9ff8-706c9f367c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:23.593938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067949d-5ef0-43b5-a55c-999d01ad7d50 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.594972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b5ab4-e6c1-44a4-9ff8-706c9f367c19 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:23.595525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b5ab4-e6c1-44a4-9ff8-706c9f367c19 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:23.596011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b5ab4-e6c1-44a4-9ff8-706c9f367c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:23.612220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b5ab4-e6c1-44a4-9ff8-706c9f367c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:23.614086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b5ab4-e6c1-44a4-9ff8-706c9f367c19 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-8c1b5ab4-e6c1-44a4-9ff8-706c9f367c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:23.635024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:23.636184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:23.637044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:23.637044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:23.637044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:23.637044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:23.637270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd71769-2b83-4aac-a218-795f8f78829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:23.637722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd71769-2b83-4aac-a218-795f8f78829e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:23.637722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd71769-2b83-4aac-a218-795f8f78829e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:23.638011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd71769-2b83-4aac-a218-795f8f78829e None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:23.638763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd71769-2b83-4aac-a218-795f8f78829e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:23.639133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd71769-2b83-4aac-a218-795f8f78829e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:23.640393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 336/653] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:23.640497 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd71769-2b83-4aac-a218-795f8f78829e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:23.641466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b5ab4-e6c1-44a4-9ff8-706c9f367c19 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:23.653820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 318/654] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:23.654861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd71769-2b83-4aac-a218-795f8f78829e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:23.703413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:23.767229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd71769-2b83-4aac-a218-795f8f78829e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.776483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b5ab4-e6c1-44a4-9ff8-706c9f367c19 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.793724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:23.818973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76380c-2d46-4df3-a7e8-618fe6208197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:23.819969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76380c-2d46-4df3-a7e8-618fe6208197 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:23.820334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76380c-2d46-4df3-a7e8-618fe6208197 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:23.820677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76380c-2d46-4df3-a7e8-618fe6208197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:23.822081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7af5b-a7f9-4988-a80b-e79e3d2a9eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:23.823378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7af5b-a7f9-4988-a80b-e79e3d2a9eb0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:23.824048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7af5b-a7f9-4988-a80b-e79e3d2a9eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:23.825195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7af5b-a7f9-4988-a80b-e79e3d2a9eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:23.826678 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7af5b-a7f9-4988-a80b-e79e3d2a9eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:23.827464 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7af5b-a7f9-4988-a80b-e79e3d2a9eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:23.830101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7af5b-a7f9-4988-a80b-e79e3d2a9eb0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:23.833123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76380c-2d46-4df3-a7e8-618fe6208197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:23.835099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76380c-2d46-4df3-a7e8-618fe6208197 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:23.844637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 319/655] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:23.846114 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7af5b-a7f9-4988-a80b-e79e3d2a9eb0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ab76380c-2d46-4df3-a7e8-618fe6208197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:23.856772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:23.858397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:23.859505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:23.859505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:23.859505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:23.859505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:23.861311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 337/656] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:23.862127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76380c-2d46-4df3-a7e8-618fe6208197 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:23.971569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76380c-2d46-4df3-a7e8-618fe6208197 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:23.978471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:23.983002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7af5b-a7f9-4988-a80b-e79e3d2a9eb0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:24.009527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b2fc8-0b0f-4fec-b76a-50866e7a20d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:24.010791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b2fc8-0b0f-4fec-b76a-50866e7a20d7 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.011292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b2fc8-0b0f-4fec-b76a-50866e7a20d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.011813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b2fc8-0b0f-4fec-b76a-50866e7a20d7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.020856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b2fc8-0b0f-4fec-b76a-50866e7a20d7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:24.022610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b2fc8-0b0f-4fec-b76a-50866e7a20d7 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:24.026686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e7b4b-4c76-41fe-832b-231de77bde14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:24.028099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e7b4b-4c76-41fe-832b-231de77bde14 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.028445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e7b4b-4c76-41fe-832b-231de77bde14 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.028791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e7b4b-4c76-41fe-832b-231de77bde14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.036399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e7b4b-4c76-41fe-832b-231de77bde14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:24.037946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e7b4b-4c76-41fe-832b-231de77bde14 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-418b2fc8-0b0f-4fec-b76a-50866e7a20d7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:24.041328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:24.042396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:24.043417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:24.043417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:24.043417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:24.043417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:24.043417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:24.043417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:24.043417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:24.043417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:24.043417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 08:33:24.043417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:24.046320 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 338/657] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:24.047377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b2fc8-0b0f-4fec-b76a-50866e7a20d7 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-428e7b4b-4c76-41fe-832b-231de77bde14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:24.055535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:24.056452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:24.057342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:24.057342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:24.057342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:24.057342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:24.057342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:24.057342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:24.057342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:24.057342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:24.061434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 320/658] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:24.061434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e7b4b-4c76-41fe-832b-231de77bde14 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:24.085009 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:24.174827 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b2fc8-0b0f-4fec-b76a-50866e7a20d7 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:24.189106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e7b4b-4c76-41fe-832b-231de77bde14 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:24.223878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13493-7daf-43c6-963b-51d0fee805b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:24.224475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13493-7daf-43c6-963b-51d0fee805b6 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.224761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13493-7daf-43c6-963b-51d0fee805b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.225040 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13493-7daf-43c6-963b-51d0fee805b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.225872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13493-7daf-43c6-963b-51d0fee805b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:24.226185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13493-7daf-43c6-963b-51d0fee805b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:24.226299 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4e250-d182-4036-8444-1adf671a3604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:24.227165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4e250-d182-4036-8444-1adf671a3604 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.227588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13493-7daf-43c6-963b-51d0fee805b6 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:24.227875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4e250-d182-4036-8444-1adf671a3604 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.228334 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4e250-d182-4036-8444-1adf671a3604 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.229414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4e250-d182-4036-8444-1adf671a3604 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:24.229954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4e250-d182-4036-8444-1adf671a3604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:24.231586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4e250-d182-4036-8444-1adf671a3604 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:24.241586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 339/659] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:24.242688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13493-7daf-43c6-963b-51d0fee805b6 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:24.256058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 321/660] 10.222.0.78 () {56 vars in 1139 bytes} [Fri Jun 17 08:33:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:24.257397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4e250-d182-4036-8444-1adf671a3604 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:24.283129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:24.349195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:24.368310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13493-7daf-43c6-963b-51d0fee805b6 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:24.381836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4e250-d182-4036-8444-1adf671a3604 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:24.415239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321972f3-979a-45bb-a1eb-1ef155fc0790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:24.416283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321972f3-979a-45bb-a1eb-1ef155fc0790 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.416608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321972f3-979a-45bb-a1eb-1ef155fc0790 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.416894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321972f3-979a-45bb-a1eb-1ef155fc0790 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.417982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321972f3-979a-45bb-a1eb-1ef155fc0790 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:24.418300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321972f3-979a-45bb-a1eb-1ef155fc0790 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:24.420011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321972f3-979a-45bb-a1eb-1ef155fc0790 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:24.421715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b706e3d-d5df-4582-8259-a4c4451f107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:24.422511 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b706e3d-d5df-4582-8259-a4c4451f107a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.422790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b706e3d-d5df-4582-8259-a4c4451f107a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.423058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b706e3d-d5df-4582-8259-a4c4451f107a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.430613 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b706e3d-d5df-4582-8259-a4c4451f107a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:24.432078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b706e3d-d5df-4582-8259-a4c4451f107a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:24.432724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 340/661] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:24.438209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321972f3-979a-45bb-a1eb-1ef155fc0790 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-5b706e3d-d5df-4582-8259-a4c4451f107a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:24.448090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:24.449048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:24.450235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 322/662] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Jun 17 08:33:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:24.451473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47b96-6c2f-4681-98e7-299cb70d425e None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.452509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47b96-6c2f-4681-98e7-299cb70d425e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.452690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47b96-6c2f-4681-98e7-299cb70d425e None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.455827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 323/663] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:24.455827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f47b96-6c2f-4681-98e7-299cb70d425e None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:24.540801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:24.561516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321972f3-979a-45bb-a1eb-1ef155fc0790 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:24.565804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f47b96-6c2f-4681-98e7-299cb70d425e None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:24.600120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab16353-0be5-4f88-84bf-ee1f45bd7986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:24.600776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab16353-0be5-4f88-84bf-ee1f45bd7986 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.601082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab16353-0be5-4f88-84bf-ee1f45bd7986 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.601331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab16353-0be5-4f88-84bf-ee1f45bd7986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.604036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c72cf6-3cda-4eb6-85a2-a9da19fcea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:24.604690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c72cf6-3cda-4eb6-85a2-a9da19fcea58 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.604967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c72cf6-3cda-4eb6-85a2-a9da19fcea58 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.605240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c72cf6-3cda-4eb6-85a2-a9da19fcea58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.606067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c72cf6-3cda-4eb6-85a2-a9da19fcea58 None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=bd7feb1014c44c5a9b3832bad417b47c) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:24.606384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c72cf6-3cda-4eb6-85a2-a9da19fcea58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:24.607991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c72cf6-3cda-4eb6-85a2-a9da19fcea58 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:24.614695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 324/664] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:24 2022] GET /identity/v3/role_assignments?user.id=bd7feb1014c44c5a9b3832bad417b47c&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:24.615442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c72cf6-3cda-4eb6-85a2-a9da19fcea58 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:24.629671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:24.695133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab16353-0be5-4f88-84bf-ee1f45bd7986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:24.697030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab16353-0be5-4f88-84bf-ee1f45bd7986 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:24.768939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c72cf6-3cda-4eb6-85a2-a9da19fcea58 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:24.814430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd366-6b4f-4158-b8be-ffcafce8155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:24.815154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd366-6b4f-4158-b8be-ffcafce8155e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.815593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd366-6b4f-4158-b8be-ffcafce8155e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.815941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcd366-6b4f-4158-b8be-ffcafce8155e None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.816787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcd366-6b4f-4158-b8be-ffcafce8155e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:24.817096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcd366-6b4f-4158-b8be-ffcafce8155e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:24.818556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcd366-6b4f-4158-b8be-ffcafce8155e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:24.823415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 341/665] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:33:24.824645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4b1b0-5a87-442b-b345-4fe04deafbc3 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:24.825125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4b1b0-5a87-442b-b345-4fe04deafbc3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:24.825397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4b1b0-5a87-442b-b345-4fe04deafbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:24.834089 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:24.838569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 325/666] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Jun 17 08:33:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:24.839265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd366-6b4f-4158-b8be-ffcafce8155e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:24.960685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcd366-6b4f-4158-b8be-ffcafce8155e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:24.962868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-2be4b1b0-5a87-442b-b345-4fe04deafbc3 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:24.964094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2be4b1b0-5a87-442b-b345-4fe04deafbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:25.011037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2983d6-70b2-496e-9135-016aee712e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:25.011876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2983d6-70b2-496e-9135-016aee712e63 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:25.012156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2983d6-70b2-496e-9135-016aee712e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:25.012486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2983d6-70b2-496e-9135-016aee712e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:25.021821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:25.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2983d6-70b2-496e-9135-016aee712e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:25.030637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2983d6-70b2-496e-9135-016aee712e63 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-db2983d6-70b2-496e-9135-016aee712e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:25.052861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:25.053775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:25.054656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:25.054656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:25.054656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:25.054656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:25.054656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 326/668] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:25.055212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2983d6-70b2-496e-9135-016aee712e63 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:25.059420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 342/668] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:25.061324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4b1b0-5a87-442b-b345-4fe04deafbc3 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:25.118809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:25.180669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2983d6-70b2-496e-9135-016aee712e63 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:25.203088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4b1b0-5a87-442b-b345-4fe04deafbc3 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:25.225909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426f103-2b57-4114-9e63-cf908ee0b025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:25.227078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f103-2b57-4114-9e63-cf908ee0b025 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:25.227375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f103-2b57-4114-9e63-cf908ee0b025 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:25.227938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f103-2b57-4114-9e63-cf908ee0b025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:25.243436 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a3d05-38cc-4daf-bd15-a30817d605b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:25.244164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a3d05-38cc-4daf-bd15-a30817d605b6 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:25.244448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a3d05-38cc-4daf-bd15-a30817d605b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:25.244721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a3d05-38cc-4daf-bd15-a30817d605b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:25.245476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a3d05-38cc-4daf-bd15-a30817d605b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:25.245782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a3d05-38cc-4daf-bd15-a30817d605b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:25.247724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a3d05-38cc-4daf-bd15-a30817d605b6 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:25.264845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 343/669] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:25.266095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a3d05-38cc-4daf-bd15-a30817d605b6 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:25.305372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426f103-2b57-4114-9e63-cf908ee0b025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:25.307153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426f103-2b57-4114-9e63-cf908ee0b025 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:25.308502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:25.362269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:25.386326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a3d05-38cc-4daf-bd15-a30817d605b6 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:25.414424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 327/670] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:33:25.415628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426f103-2b57-4114-9e63-cf908ee0b025 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:25.427191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd434dd-b4be-4993-b6c2-7eaaa1d7fc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:25.428404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd434dd-b4be-4993-b6c2-7eaaa1d7fc44 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:25.428542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd434dd-b4be-4993-b6c2-7eaaa1d7fc44 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:25.428787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd434dd-b4be-4993-b6c2-7eaaa1d7fc44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:25.441525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd434dd-b4be-4993-b6c2-7eaaa1d7fc44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ddd434dd-b4be-4993-b6c2-7eaaa1d7fc44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:25.450647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:25.452190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:25.453016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:25.459328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 344/671] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:25.460325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd434dd-b4be-4993-b6c2-7eaaa1d7fc44 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:25.537116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426f103-2b57-4114-9e63-cf908ee0b025 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:25.566538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:25.572681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd434dd-b4be-4993-b6c2-7eaaa1d7fc44 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:25.582532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75592ea7-622b-479e-9386-643dcea2d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:25.583674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75592ea7-622b-479e-9386-643dcea2d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:25.584066 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75592ea7-622b-479e-9386-643dcea2d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:25.584486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75592ea7-622b-479e-9386-643dcea2d8e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:25.592938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75592ea7-622b-479e-9386-643dcea2d8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:25.594834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75592ea7-622b-479e-9386-643dcea2d8e2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:25.609740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3598a47-ed64-48ad-b398-27b961354f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:25.610807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3598a47-ed64-48ad-b398-27b961354f0c None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:25.611263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3598a47-ed64-48ad-b398-27b961354f0c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:25.611754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3598a47-ed64-48ad-b398-27b961354f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-75592ea7-622b-479e-9386-643dcea2d8e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:25.614004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:25.614852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:25.615779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:25.615779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:25.615779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:25.615779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:25.615779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:25.615779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:25.615779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:25.615779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:25.620140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 328/672] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:25.621457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75592ea7-622b-479e-9386-643dcea2d8e2 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:25.626336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3598a47-ed64-48ad-b398-27b961354f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:25.627999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3598a47-ed64-48ad-b398-27b961354f0c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:25.640785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-b3598a47-ed64-48ad-b398-27b961354f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:25.647639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:25.648497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:25.649377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:25.649377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:25.649377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:25.649377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:25.651618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 345/673] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:25.652637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3598a47-ed64-48ad-b398-27b961354f0c None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:25.738806 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75592ea7-622b-479e-9386-643dcea2d8e2 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:25.755738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3598a47-ed64-48ad-b398-27b961354f0c None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:25.789849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef37ba-f8cd-49dc-b965-06b3485a9a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:25.790548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef37ba-f8cd-49dc-b965-06b3485a9a1e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:25.790884 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef37ba-f8cd-49dc-b965-06b3485a9a1e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:25.791217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef37ba-f8cd-49dc-b965-06b3485a9a1e None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:25.792118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef37ba-f8cd-49dc-b965-06b3485a9a1e None admin] RBAC: Adding query filter params (name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:25.792586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef37ba-f8cd-49dc-b965-06b3485a9a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:25.794384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef37ba-f8cd-49dc-b965-06b3485a9a1e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:25.799099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8610-f16c-4499-afcb-148173d86c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:25.800135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8610-f16c-4499-afcb-148173d86c7a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:25.800621 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8610-f16c-4499-afcb-148173d86c7a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:25.801110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8610-f16c-4499-afcb-148173d86c7a None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:25.802157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba8610-f16c-4499-afcb-148173d86c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:25.802660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba8610-f16c-4499-afcb-148173d86c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:25.804428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba8610-f16c-4499-afcb-148173d86c7a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:25.810231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 329/674] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:25.811337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef37ba-f8cd-49dc-b965-06b3485a9a1e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:25.818320 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 346/675] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:25.819418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8610-f16c-4499-afcb-148173d86c7a None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:25.831494 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:25.900309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:25.928374 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef37ba-f8cd-49dc-b965-06b3485a9a1e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:25.935242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8610-f16c-4499-afcb-148173d86c7a None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:25.969422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6c96-92e9-4354-ad4d-90ed72eae3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:25.970446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6c96-92e9-4354-ad4d-90ed72eae3ba None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:25.970954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6c96-92e9-4354-ad4d-90ed72eae3ba None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:25.971477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6c96-92e9-4354-ad4d-90ed72eae3ba None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:25.972301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6c96-92e9-4354-ad4d-90ed72eae3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:25.972614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6c96-92e9-4354-ad4d-90ed72eae3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:25.972838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a06028-737e-465f-8e5a-e599a7a62cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:25.973592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06028-737e-465f-8e5a-e599a7a62cbd None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:25.973879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06028-737e-465f-8e5a-e599a7a62cbd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:25.973978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6c96-92e9-4354-ad4d-90ed72eae3ba None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:25.974170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a06028-737e-465f-8e5a-e599a7a62cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:25.986691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a06028-737e-465f-8e5a-e599a7a62cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:25.988167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a06028-737e-465f-8e5a-e599a7a62cbd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:25.991256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 330/676] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:25.992032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6c96-92e9-4354-ad4d-90ed72eae3ba None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-16a06028-737e-465f-8e5a-e599a7a62cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:26.008127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:26.009172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:26.014973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:26.014973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:26.014973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:26.014973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:26.014973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 347/677] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:26.014973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863cbfa-aab9-447f-bc24-f3d4746c7d39 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.014973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863cbfa-aab9-447f-bc24-f3d4746c7d39 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.014973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863cbfa-aab9-447f-bc24-f3d4746c7d39 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.014973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 348/678] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:26.015623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863cbfa-aab9-447f-bc24-f3d4746c7d39 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:26.078706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:26.109282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6c96-92e9-4354-ad4d-90ed72eae3ba None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:26.125234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863cbfa-aab9-447f-bc24-f3d4746c7d39 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:26.144425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca523d-8ef1-4432-b588-90485546a077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:26.145208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca523d-8ef1-4432-b588-90485546a077 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.145558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca523d-8ef1-4432-b588-90485546a077 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.145885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca523d-8ef1-4432-b588-90485546a077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.146819 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca523d-8ef1-4432-b588-90485546a077 None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=024e0e53cfdb42e88dfdfde7a79e8c75) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:26.147176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca523d-8ef1-4432-b588-90485546a077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:26.148883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca523d-8ef1-4432-b588-90485546a077 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:26.151056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:26.157287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 331/679] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:25 2022] GET /identity/v3/role_assignments?user.id=024e0e53cfdb42e88dfdfde7a79e8c75&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:26.158201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca523d-8ef1-4432-b588-90485546a077 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:26.174249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832e40e-739b-4158-a3ed-68238cf2b0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:26.175839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832e40e-739b-4158-a3ed-68238cf2b0cf None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.176372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832e40e-739b-4158-a3ed-68238cf2b0cf None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.177011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832e40e-739b-4158-a3ed-68238cf2b0cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.187586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832e40e-739b-4158-a3ed-68238cf2b0cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:26.189841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832e40e-739b-4158-a3ed-68238cf2b0cf None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-a832e40e-739b-4158-a3ed-68238cf2b0cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:26.211381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:26.212354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:26.213271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:26.213271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:26.213271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:26.213271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:26.213271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:26.213271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:26.213271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:26.213271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:26.216330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 349/680] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:26.218661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fdbf8-eaab-458f-9456-f15526e30838 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.219117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fdbf8-eaab-458f-9456-f15526e30838 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.219687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fdbf8-eaab-458f-9456-f15526e30838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.240853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-881fdbf8-eaab-458f-9456-f15526e30838 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:26.241824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-881fdbf8-eaab-458f-9456-f15526e30838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:26.305106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca523d-8ef1-4432-b588-90485546a077 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:26.320397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 350/681] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:26.321416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fdbf8-eaab-458f-9456-f15526e30838 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:26.348220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5bbe5-b7d9-4e86-8085-4bfd0643840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:26.348894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5bbe5-b7d9-4e86-8085-4bfd0643840b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.349174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5bbe5-b7d9-4e86-8085-4bfd0643840b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.349447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5bbe5-b7d9-4e86-8085-4bfd0643840b None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.350167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5bbe5-b7d9-4e86-8085-4bfd0643840b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:26.350474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5bbe5-b7d9-4e86-8085-4bfd0643840b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:26.351879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5bbe5-b7d9-4e86-8085-4bfd0643840b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:26.366863 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 332/682] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:26.367751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5bbe5-b7d9-4e86-8085-4bfd0643840b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:26.392715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:26.442166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:26.454646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fdbf8-eaab-458f-9456-f15526e30838 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:26.504735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5bbe5-b7d9-4e86-8085-4bfd0643840b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:26.505840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111840-0206-4fec-88ef-2f75f9f13067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:26.507810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111840-0206-4fec-88ef-2f75f9f13067 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.508253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111840-0206-4fec-88ef-2f75f9f13067 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.508681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111840-0206-4fec-88ef-2f75f9f13067 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.509711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d111840-0206-4fec-88ef-2f75f9f13067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:26.510169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d111840-0206-4fec-88ef-2f75f9f13067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:26.511803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d111840-0206-4fec-88ef-2f75f9f13067 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:26.530357 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 351/683] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:26.531834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111840-0206-4fec-88ef-2f75f9f13067 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:26.547665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565106f3-98f2-4fe6-a151-5e678273d150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:26.548629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565106f3-98f2-4fe6-a151-5e678273d150 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.548917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565106f3-98f2-4fe6-a151-5e678273d150 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.549310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565106f3-98f2-4fe6-a151-5e678273d150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.565504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565106f3-98f2-4fe6-a151-5e678273d150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:26.567285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565106f3-98f2-4fe6-a151-5e678273d150 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-565106f3-98f2-4fe6-a151-5e678273d150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:26.589245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:26.590206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:26.591100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:26.591100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:26.591100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:26.591100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:26.596933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 333/684] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:26.598043 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565106f3-98f2-4fe6-a151-5e678273d150 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:26.671222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111840-0206-4fec-88ef-2f75f9f13067 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:26.684589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:26.710100 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bdefa-9530-4316-b458-81c2a287f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:26.710960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bdefa-9530-4316-b458-81c2a287f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.711245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bdefa-9530-4316-b458-81c2a287f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.711564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bdefa-9530-4316-b458-81c2a287f2f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.720516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bdefa-9530-4316-b458-81c2a287f2f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:26.722138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bdefa-9530-4316-b458-81c2a287f2f7 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:26.739680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565106f3-98f2-4fe6-a151-5e678273d150 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-9b0bdefa-9530-4316-b458-81c2a287f2f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:26.741627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:26.742549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:26.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:26.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:26.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:26.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:26.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:26.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:26.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:26.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:26.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:26.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:26.747671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 352/685] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:26.749479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bdefa-9530-4316-b458-81c2a287f2f7 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:26.757838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:26.791143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965030-9cfa-433b-8413-629fe024a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:26.792117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965030-9cfa-433b-8413-629fe024a27e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.792534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965030-9cfa-433b-8413-629fe024a27e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.792960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9965030-9cfa-433b-8413-629fe024a27e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.793943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9965030-9cfa-433b-8413-629fe024a27e None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=6aa3618089794b938018ff2666afebe3) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:26.794407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9965030-9cfa-433b-8413-629fe024a27e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:26.797092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9965030-9cfa-433b-8413-629fe024a27e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:26.804121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 334/686] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:26 2022] GET /identity/v3/role_assignments?user.id=6aa3618089794b938018ff2666afebe3&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:26.805143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965030-9cfa-433b-8413-629fe024a27e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:26.926694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bdefa-9530-4316-b458-81c2a287f2f7 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:26.942635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9965030-9cfa-433b-8413-629fe024a27e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:26.984247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c1e38-6fc7-40e1-a988-e10607ab94c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:26.985509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c1e38-6fc7-40e1-a988-e10607ab94c0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.986005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c1e38-6fc7-40e1-a988-e10607ab94c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.986249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d2fbd-d4ab-4775-901d-bf93e001d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:26.986709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c1e38-6fc7-40e1-a988-e10607ab94c0 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.986934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d2fbd-d4ab-4775-901d-bf93e001d81b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:26.987220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d2fbd-d4ab-4775-901d-bf93e001d81b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:26.987532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d2fbd-d4ab-4775-901d-bf93e001d81b None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:26.988333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c1e38-6fc7-40e1-a988-e10607ab94c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:26.988444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d2fbd-d4ab-4775-901d-bf93e001d81b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:26.988689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d2fbd-d4ab-4775-901d-bf93e001d81b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:26.989174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c1e38-6fc7-40e1-a988-e10607ab94c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:26.990145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d2fbd-d4ab-4775-901d-bf93e001d81b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:26.991008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c1e38-6fc7-40e1-a988-e10607ab94c0 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:27.010289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 353/687] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:27.011851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 335/688] 10.222.0.78 () {56 vars in 1135 bytes} [Fri Jun 17 08:33:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:27.012289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f21ed-0249-4d20-9c56-4bce5f40b0c8 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:27.012738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f21ed-0249-4d20-9c56-4bce5f40b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:27.013021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f21ed-0249-4d20-9c56-4bce5f40b0c8 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:27.019564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 354/689] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:27.020918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f21ed-0249-4d20-9c56-4bce5f40b0c8 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:27.021054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d2fbd-d4ab-4775-901d-bf93e001d81b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:27.057757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:27.067232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:27.153407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d2fbd-d4ab-4775-901d-bf93e001d81b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:27.160004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f21ed-0249-4d20-9c56-4bce5f40b0c8 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:27.212363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d5c55-e0d4-4762-ab95-1379b182461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:27.213470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5c55-e0d4-4762-ab95-1379b182461f None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:27.213946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5c55-e0d4-4762-ab95-1379b182461f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:27.214422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5c55-e0d4-4762-ab95-1379b182461f None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:27.215734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a28f13-df8c-4c8b-9678-9d40f98cebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:27.215878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d5c55-e0d4-4762-ab95-1379b182461f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:27.216465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a28f13-df8c-4c8b-9678-9d40f98cebd1 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:27.216703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a28f13-df8c-4c8b-9678-9d40f98cebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:27.216978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a28f13-df8c-4c8b-9678-9d40f98cebd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:27.218438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d5c55-e0d4-4762-ab95-1379b182461f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:27.294061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a28f13-df8c-4c8b-9678-9d40f98cebd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:27.296100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a28f13-df8c-4c8b-9678-9d40f98cebd1 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:27.331576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 355/690] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:33:27 2022] POST /identity/v3/users => generated 254 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:27.334017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a907f-8acc-4b23-a35a-1226a228f144 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:27.334511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a907f-8acc-4b23-a35a-1226a228f144 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:27.334993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a907f-8acc-4b23-a35a-1226a228f144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:27.344499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:27.391208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3f0a907f-8acc-4b23-a35a-1226a228f144 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:27.392986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3f0a907f-8acc-4b23-a35a-1226a228f144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:27.524273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 336/691] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 08:33:27.534285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a28f13-df8c-4c8b-9678-9d40f98cebd1 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:27.593410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 356/692] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:27.644617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a907f-8acc-4b23-a35a-1226a228f144 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:27.673933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:27.725754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a28f13-df8c-4c8b-9678-9d40f98cebd1 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:27.786069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:27.791585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a907f-8acc-4b23-a35a-1226a228f144 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:27.797100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11720a1b-e27e-4fc6-b9b9-10bff300e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:27.798474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11720a1b-e27e-4fc6-b9b9-10bff300e20a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:27.798979 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11720a1b-e27e-4fc6-b9b9-10bff300e20a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:27.799527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11720a1b-e27e-4fc6-b9b9-10bff300e20a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:27.821152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11720a1b-e27e-4fc6-b9b9-10bff300e20a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:27.824555 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11720a1b-e27e-4fc6-b9b9-10bff300e20a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:27.833908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2fb42-669a-492f-bb22-2d879185ad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:27.834722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2fb42-669a-492f-bb22-2d879185ad32 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:27.835058 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2fb42-669a-492f-bb22-2d879185ad32 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:27.835336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2fb42-669a-492f-bb22-2d879185ad32 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:27.836080 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2fb42-669a-492f-bb22-2d879185ad32 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:27.837495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2fb42-669a-492f-bb22-2d879185ad32 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-10a2fb42-669a-492f-bb22-2d879185ad32 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:27.854927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:27.855950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:27.856795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 357/693] 10.222.0.78 () {56 vars in 1129 bytes} [Fri Jun 17 08:33:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:27.864809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2fb42-669a-492f-bb22-2d879185ad32 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-11720a1b-e27e-4fc6-b9b9-10bff300e20a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:27.865471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:27.867546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:27.869507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:27.869507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:27.869507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:27.869507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:27.869507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 337/694] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:27.881319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11720a1b-e27e-4fc6-b9b9-10bff300e20a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:27.959625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:27.984346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2fb42-669a-492f-bb22-2d879185ad32 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:28.062298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f092b77-e9d5-4081-aedf-7030d234b0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:28.063439 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f092b77-e9d5-4081-aedf-7030d234b0c3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:28.063946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f092b77-e9d5-4081-aedf-7030d234b0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:28.064485 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f092b77-e9d5-4081-aedf-7030d234b0c3 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:28.065994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f092b77-e9d5-4081-aedf-7030d234b0c3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:28.066528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f092b77-e9d5-4081-aedf-7030d234b0c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:28.069272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f092b77-e9d5-4081-aedf-7030d234b0c3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:28.079332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 358/695] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Jun 17 08:33:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:28.087914 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f092b77-e9d5-4081-aedf-7030d234b0c3 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:28.121360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11720a1b-e27e-4fc6-b9b9-10bff300e20a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:28.222446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1260d-9284-4f64-839e-70d585549ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:28.223537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1260d-9284-4f64-839e-70d585549ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:28.223997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1260d-9284-4f64-839e-70d585549ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:28.224443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1260d-9284-4f64-839e-70d585549ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:28.225677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1260d-9284-4f64-839e-70d585549ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:28.226189 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1260d-9284-4f64-839e-70d585549ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:28.228604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1260d-9284-4f64-839e-70d585549ee3 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:28.271510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 338/696] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:28.281824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f092b77-e9d5-4081-aedf-7030d234b0c3 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:28.290405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1260d-9284-4f64-839e-70d585549ee3 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:28.350428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40259f1-058e-4932-9b29-aaf499f727cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:28.351557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40259f1-058e-4932-9b29-aaf499f727cf None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:28.352036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40259f1-058e-4932-9b29-aaf499f727cf None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:28.352553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40259f1-058e-4932-9b29-aaf499f727cf None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:28.353921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40259f1-058e-4932-9b29-aaf499f727cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:28.354532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40259f1-058e-4932-9b29-aaf499f727cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:28.357234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40259f1-058e-4932-9b29-aaf499f727cf None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:28.368388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 359/697] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Jun 17 08:33:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:28.408848 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:28.478682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1260d-9284-4f64-839e-70d585549ee3 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:28.539934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bf1a1-9e83-458a-9188-53484810309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:28.540758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bf1a1-9e83-458a-9188-53484810309d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:28.541045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bf1a1-9e83-458a-9188-53484810309d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:28.541332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bf1a1-9e83-458a-9188-53484810309d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:28.554936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bf1a1-9e83-458a-9188-53484810309d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:28.556498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bf1a1-9e83-458a-9188-53484810309d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-6b0bf1a1-9e83-458a-9188-53484810309d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:28.573208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:28.574155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:28.575300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:28.575300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:28.575300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:28.575300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:28.575300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:28.575300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:28.575300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:28.575300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:28.575300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 339/698] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:28.585819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40259f1-058e-4932-9b29-aaf499f727cf None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:28.603133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:28.714429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40259f1-058e-4932-9b29-aaf499f727cf None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:28.752706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051bd40-ced5-4b12-b115-c84db224aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:28.753382 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051bd40-ced5-4b12-b115-c84db224aa90 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:28.753661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051bd40-ced5-4b12-b115-c84db224aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:28.753866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24571a-4604-4115-8067-e4919301f982 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:28.754356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051bd40-ced5-4b12-b115-c84db224aa90 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:28.754506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24571a-4604-4115-8067-e4919301f982 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:28.754506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24571a-4604-4115-8067-e4919301f982 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:28.754793 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051bd40-ced5-4b12-b115-c84db224aa90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:28.755076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051bd40-ced5-4b12-b115-c84db224aa90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:28.756826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051bd40-ced5-4b12-b115-c84db224aa90 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:28.757457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 340/699] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:28.761934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2606-f1b5-4335-9ddc-3d494c2c4fca None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:28.762229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2606-f1b5-4335-9ddc-3d494c2c4fca None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:28.762515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf2606-f1b5-4335-9ddc-3d494c2c4fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:28.776603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 360/700] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:28.781211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-7dbf2606-f1b5-4335-9ddc-3d494c2c4fca None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:28.782626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051bd40-ced5-4b12-b115-c84db224aa90 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:28.783012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-7dbf2606-f1b5-4335-9ddc-3d494c2c4fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:28.875588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 341/701] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:28.896990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2606-f1b5-4335-9ddc-3d494c2c4fca None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:28.905933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:28.939310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:28.968219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051bd40-ced5-4b12-b115-c84db224aa90 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:29.005817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab709ec-48e4-4709-af29-15af276817ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:29.006796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab709ec-48e4-4709-af29-15af276817ba None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:29.007284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab709ec-48e4-4709-af29-15af276817ba None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:29.007796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab709ec-48e4-4709-af29-15af276817ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:29.009008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab709ec-48e4-4709-af29-15af276817ba None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=46e2b769ba9b46778c96b2a04d45612d) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:29.009594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab709ec-48e4-4709-af29-15af276817ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:29.011233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab709ec-48e4-4709-af29-15af276817ba None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:29.019420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 361/702] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:28 2022] GET /identity/v3/role_assignments?user.id=46e2b769ba9b46778c96b2a04d45612d&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:29.046981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf2606-f1b5-4335-9ddc-3d494c2c4fca None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:29.092879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75301ed-067a-4188-9a55-ba465ac89c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:29.094061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75301ed-067a-4188-9a55-ba465ac89c94 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:29.094527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75301ed-067a-4188-9a55-ba465ac89c94 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:29.094984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75301ed-067a-4188-9a55-ba465ac89c94 None admin] PATH_INFO: `/v3/services/network` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:29.095862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75301ed-067a-4188-9a55-ba465ac89c94 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:29.097495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75301ed-067a-4188-9a55-ba465ac89c94 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-d75301ed-067a-4188-9a55-ba465ac89c94 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:29.115777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:29.116873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:33:29.117729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:29.124964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 342/703] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:28 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:29.131214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab709ec-48e4-4709-af29-15af276817ba None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:29.251525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab709ec-48e4-4709-af29-15af276817ba None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:29.287938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da5012-f7c8-46bf-9737-677f5faf3146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:29.288864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5012-f7c8-46bf-9737-677f5faf3146 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:29.289327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5012-f7c8-46bf-9737-677f5faf3146 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:29.289792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5012-f7c8-46bf-9737-677f5faf3146 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:29.290702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da5012-f7c8-46bf-9737-677f5faf3146 None admin] RBAC: Adding query filter params (name=network) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:29.291169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da5012-f7c8-46bf-9737-677f5faf3146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:29.296234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:29.296645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da5012-f7c8-46bf-9737-677f5faf3146 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:29.301906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 362/704] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:33:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:29.307528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75301ed-067a-4188-9a55-ba465ac89c94 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:29.421980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:29.427302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75301ed-067a-4188-9a55-ba465ac89c94 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:29.466468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a335b-6dab-4f5e-937b-3b7dd88a4a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:29.468383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a335b-6dab-4f5e-937b-3b7dd88a4a35 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:29.468383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a335b-6dab-4f5e-937b-3b7dd88a4a35 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:29.468383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a335b-6dab-4f5e-937b-3b7dd88a4a35 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:29.468383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a335b-6dab-4f5e-937b-3b7dd88a4a35 None admin] RBAC: Adding query filter params (type=network) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:29.468700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a335b-6dab-4f5e-937b-3b7dd88a4a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:29.470052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a335b-6dab-4f5e-937b-3b7dd88a4a35 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:29.477232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 343/705] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:33:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:29.502187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c0cf-5df2-4d62-97d3-8c7d1a9e341b None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:29.502468 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c0cf-5df2-4d62-97d3-8c7d1a9e341b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:29.502671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c0cf-5df2-4d62-97d3-8c7d1a9e341b None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:29.504165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 363/706] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:29.510348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26dc40-5f81-46b7-9a28-e92332ba9b2c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:29.510650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26dc40-5f81-46b7-9a28-e92332ba9b2c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:29.510896 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26dc40-5f81-46b7-9a28-e92332ba9b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:29.535499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-dd26dc40-5f81-46b7-9a28-e92332ba9b2c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:29.536806 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-dd26dc40-5f81-46b7-9a28-e92332ba9b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:29.636037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 344/707] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:29.667196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c0cf-5df2-4d62-97d3-8c7d1a9e341b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:29.780295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c0cf-5df2-4d62-97d3-8c7d1a9e341b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:29.815988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c555-5110-43b1-9965-224d1e1f6aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:29.816783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c555-5110-43b1-9965-224d1e1f6aa4 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:29.817069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c555-5110-43b1-9965-224d1e1f6aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:29.817349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c555-5110-43b1-9965-224d1e1f6aa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:29.828976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5c555-5110-43b1-9965-224d1e1f6aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-86f5c555-5110-43b1-9965-224d1e1f6aa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:29.836587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:29.837533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:29.838386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:29.842761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 364/708] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:29.844727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26dc40-5f81-46b7-9a28-e92332ba9b2c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:29.940470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:29.949963 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26dc40-5f81-46b7-9a28-e92332ba9b2c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:29.986001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e9f4-0d4b-4cd1-a091-719b2fd399f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:29.986677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e9f4-0d4b-4cd1-a091-719b2fd399f0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:29.986960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e9f4-0d4b-4cd1-a091-719b2fd399f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:29.987239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e9f4-0d4b-4cd1-a091-719b2fd399f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:29.988087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7e9f4-0d4b-4cd1-a091-719b2fd399f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:29.988397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7e9f4-0d4b-4cd1-a091-719b2fd399f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:29.989820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7e9f4-0d4b-4cd1-a091-719b2fd399f0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:30.003233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 345/709] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:30.005162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c555-5110-43b1-9965-224d1e1f6aa4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:30.078250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:30.112546 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c555-5110-43b1-9965-224d1e1f6aa4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:30.148508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb434cff-5272-4208-ab46-6590acdcbd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:30.149307 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434cff-5272-4208-ab46-6590acdcbd0f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:30.149593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434cff-5272-4208-ab46-6590acdcbd0f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:30.149871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb434cff-5272-4208-ab46-6590acdcbd0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:30.161375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb434cff-5272-4208-ab46-6590acdcbd0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:30.162841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb434cff-5272-4208-ab46-6590acdcbd0f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-cb434cff-5272-4208-ab46-6590acdcbd0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:30.180619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:30.182714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:30.184786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:30.184786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:30.184786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:30.184786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:30.186002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 365/710] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:30.188596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e9f4-0d4b-4cd1-a091-719b2fd399f0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:30.295442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e9f4-0d4b-4cd1-a091-719b2fd399f0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:30.335579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a837-abdf-471b-a81c-1c65a3e92fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:30.336167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a837-abdf-471b-a81c-1c65a3e92fb7 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:30.336450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a837-abdf-471b-a81c-1c65a3e92fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:30.336726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3a837-abdf-471b-a81c-1c65a3e92fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:30.337444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3a837-abdf-471b-a81c-1c65a3e92fb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:30.337748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3a837-abdf-471b-a81c-1c65a3e92fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:30.339157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3a837-abdf-471b-a81c-1c65a3e92fb7 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:30.354630 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 346/711] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:30.360877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb434cff-5272-4208-ab46-6590acdcbd0f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:30.483804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb434cff-5272-4208-ab46-6590acdcbd0f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:30.493214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:30.519207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4c761-2ddc-4848-952d-9ae7410c51a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:30.520031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c761-2ddc-4848-952d-9ae7410c51a2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:30.520324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c761-2ddc-4848-952d-9ae7410c51a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:30.520602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c761-2ddc-4848-952d-9ae7410c51a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:30.528301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4c761-2ddc-4848-952d-9ae7410c51a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:30.529775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4c761-2ddc-4848-952d-9ae7410c51a2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-9fe4c761-2ddc-4848-952d-9ae7410c51a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:30.544000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:30.546769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:30.548982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:30.548982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:30.548982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:30.548982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:30.548982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:30.548982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:30.548982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:30.548982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:30.548982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:30.548982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:30.550225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 366/712] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Jun 17 08:33:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:30.555398 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a837-abdf-471b-a81c-1c65a3e92fb7 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:30.572425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:30.687429 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3a837-abdf-471b-a81c-1c65a3e92fb7 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:30.738673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f675f9e-2277-4bd8-add6-200f41eaa636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:30.739365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f675f9e-2277-4bd8-add6-200f41eaa636 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:30.739655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f675f9e-2277-4bd8-add6-200f41eaa636 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:30.739994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f675f9e-2277-4bd8-add6-200f41eaa636 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:30.740835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f675f9e-2277-4bd8-add6-200f41eaa636 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:30.741181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f675f9e-2277-4bd8-add6-200f41eaa636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:30.742608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f675f9e-2277-4bd8-add6-200f41eaa636 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:30.768964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 347/713] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Jun 17 08:33:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:30.775409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4c761-2ddc-4848-952d-9ae7410c51a2 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:30.822494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a65fe8-6c33-4471-902e-762cd347eedf None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:30.823058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a65fe8-6c33-4471-902e-762cd347eedf None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:30.823361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a65fe8-6c33-4471-902e-762cd347eedf None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:30.825259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 348/714] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:33:30.831167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470967b-123b-46f9-a29d-9e9c9ccfc9f3 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:30.831490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470967b-123b-46f9-a29d-9e9c9ccfc9f3 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:30.831770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470967b-123b-46f9-a29d-9e9c9ccfc9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:30.868343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d470967b-123b-46f9-a29d-9e9c9ccfc9f3 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:30.869539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d470967b-123b-46f9-a29d-9e9c9ccfc9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:31.005748 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4c761-2ddc-4848-952d-9ae7410c51a2 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:31.069053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 349/715] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 08:33:31.080775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91de524-9bd0-4399-b104-2c185ef95ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:31.081938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91de524-9bd0-4399-b104-2c185ef95ef3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:31.082427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91de524-9bd0-4399-b104-2c185ef95ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:31.082915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91de524-9bd0-4399-b104-2c185ef95ef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:31.093636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470967b-123b-46f9-a29d-9e9c9ccfc9f3 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:31.096417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:31.180241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:31.237648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470967b-123b-46f9-a29d-9e9c9ccfc9f3 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:31.254371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91de524-9bd0-4399-b104-2c185ef95ef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:31.257155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91de524-9bd0-4399-b104-2c185ef95ef3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:31.305001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152cdc8-7de9-4eba-a226-3153b0121b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:31.305802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152cdc8-7de9-4eba-a226-3153b0121b97 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:31.306083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152cdc8-7de9-4eba-a226-3153b0121b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:31.306357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152cdc8-7de9-4eba-a226-3153b0121b97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:31.331150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152cdc8-7de9-4eba-a226-3153b0121b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-7152cdc8-7de9-4eba-a226-3153b0121b97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:31.339051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:31.341096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:31.343086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:31.354564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 350/716] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:31.358132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152cdc8-7de9-4eba-a226-3153b0121b97 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:31.446256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 367/717] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 08:33:31.452379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91de524-9bd0-4399-b104-2c185ef95ef3 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:31.518114 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:31.590412 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152cdc8-7de9-4eba-a226-3153b0121b97 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:31.603916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:31.660712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288387e6-cdf5-478d-a0c5-5da6ddc9230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:31.661815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288387e6-cdf5-478d-a0c5-5da6ddc9230c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:31.663811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91de524-9bd0-4399-b104-2c185ef95ef3 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:31.664299 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288387e6-cdf5-478d-a0c5-5da6ddc9230c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:31.664805 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288387e6-cdf5-478d-a0c5-5da6ddc9230c None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:31.665743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288387e6-cdf5-478d-a0c5-5da6ddc9230c None admin] RBAC: Adding query filter params (name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:31.666241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288387e6-cdf5-478d-a0c5-5da6ddc9230c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:31.667842 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288387e6-cdf5-478d-a0c5-5da6ddc9230c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:31.686297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 351/718] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:31.693420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288387e6-cdf5-478d-a0c5-5da6ddc9230c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:31.744125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6eaaf-cb5b-4161-816b-27dc22c6f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:31.745325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6eaaf-cb5b-4161-816b-27dc22c6f75c None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:31.745802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6eaaf-cb5b-4161-816b-27dc22c6f75c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:31.746270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6eaaf-cb5b-4161-816b-27dc22c6f75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:31.771653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6eaaf-cb5b-4161-816b-27dc22c6f75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:31.773397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6eaaf-cb5b-4161-816b-27dc22c6f75c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-89f6eaaf-cb5b-4161-816b-27dc22c6f75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:31.798815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:31.800243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:31.801147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:31.801147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:31.801147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:31.801147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:31.803653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 368/719] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:31.805270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102fb2e-2a15-4f74-9fac-7bbd9feea019 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:31.805776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102fb2e-2a15-4f74-9fac-7bbd9feea019 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:31.806256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102fb2e-2a15-4f74-9fac-7bbd9feea019 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:31.808260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 369/720] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:31.809320 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102fb2e-2a15-4f74-9fac-7bbd9feea019 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:31.859184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288387e6-cdf5-478d-a0c5-5da6ddc9230c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:31.890575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:31.909878 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014af2c5-8b56-4c48-b941-691bd0603e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:31.910942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af2c5-8b56-4c48-b941-691bd0603e7b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:31.911294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af2c5-8b56-4c48-b941-691bd0603e7b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:31.911927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af2c5-8b56-4c48-b941-691bd0603e7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:31.925427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014af2c5-8b56-4c48-b941-691bd0603e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:31.927246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014af2c5-8b56-4c48-b941-691bd0603e7b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-014af2c5-8b56-4c48-b941-691bd0603e7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:31.951303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:31.952314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:31.953192 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:31.953192 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:31.953192 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:31.953192 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:31.953192 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 352/721] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:31.954677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09113f1-e579-4c50-9e29-b0302d479020 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:31.955026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09113f1-e579-4c50-9e29-b0302d479020 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:31.955378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09113f1-e579-4c50-9e29-b0302d479020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:31.973484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102fb2e-2a15-4f74-9fac-7bbd9feea019 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:31.979330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d09113f1-e579-4c50-9e29-b0302d479020 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:31.980695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d09113f1-e579-4c50-9e29-b0302d479020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:31.997172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:32.012858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918bcdc-b01e-4fc1-96bb-688cb4b7d2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:32.014450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918bcdc-b01e-4fc1-96bb-688cb4b7d2d2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.014931 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918bcdc-b01e-4fc1-96bb-688cb4b7d2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.015456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918bcdc-b01e-4fc1-96bb-688cb4b7d2d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.016381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918bcdc-b01e-4fc1-96bb-688cb4b7d2d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:32.016882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918bcdc-b01e-4fc1-96bb-688cb4b7d2d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:32.018493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918bcdc-b01e-4fc1-96bb-688cb4b7d2d2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:32.032251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 370/722] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:32.033296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918bcdc-b01e-4fc1-96bb-688cb4b7d2d2 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:32.064745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 353/723] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:32.066069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61344b6f-ebf9-406f-9e55-ec1b280eeb7d None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.066351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61344b6f-ebf9-406f-9e55-ec1b280eeb7d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.066623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61344b6f-ebf9-406f-9e55-ec1b280eeb7d None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.071386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 354/724] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:32.071386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61344b6f-ebf9-406f-9e55-ec1b280eeb7d None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:32.159908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918bcdc-b01e-4fc1-96bb-688cb4b7d2d2 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:32.177666 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61344b6f-ebf9-406f-9e55-ec1b280eeb7d None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:32.185705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:32.194754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150afbb9-c3f4-4e86-a967-121983320ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:32.197725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150afbb9-c3f4-4e86-a967-121983320ed2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.197725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150afbb9-c3f4-4e86-a967-121983320ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.197725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150afbb9-c3f4-4e86-a967-121983320ed2 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.197725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150afbb9-c3f4-4e86-a967-121983320ed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:32.197725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150afbb9-c3f4-4e86-a967-121983320ed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:32.198437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150afbb9-c3f4-4e86-a967-121983320ed2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:32.215830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 371/725] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:32.215830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8609e6b-25b8-41ef-aa0c-48cd769dff1c None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.215830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8609e6b-25b8-41ef-aa0c-48cd769dff1c None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.215830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8609e6b-25b8-41ef-aa0c-48cd769dff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.218977 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6122e-db3d-4a66-8f05-89a8249ba89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:32.219804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6122e-db3d-4a66-8f05-89a8249ba89e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.220090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6122e-db3d-4a66-8f05-89a8249ba89e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.220366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6122e-db3d-4a66-8f05-89a8249ba89e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.228519 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6122e-db3d-4a66-8f05-89a8249ba89e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:32.230255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6122e-db3d-4a66-8f05-89a8249ba89e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:32.232848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-e8609e6b-25b8-41ef-aa0c-48cd769dff1c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:32.234033 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e8609e6b-25b8-41ef-aa0c-48cd769dff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-5ec6122e-db3d-4a66-8f05-89a8249ba89e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:32.245255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:32.246141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:32.247140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:32.247140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:32.247140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:32.247140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:32.247140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:32.247140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:32.247140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:32.247140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:32.247140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 355/726] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:32.247768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6122e-db3d-4a66-8f05-89a8249ba89e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:32.274099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:32.309473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 372/727] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 08:33:32.316562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8609e6b-25b8-41ef-aa0c-48cd769dff1c None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:32.358918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6122e-db3d-4a66-8f05-89a8249ba89e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:32.395335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94678-47e3-4a66-bfa0-0c8ea7353aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:32.396021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94678-47e3-4a66-bfa0-0c8ea7353aaf None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.396305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94678-47e3-4a66-bfa0-0c8ea7353aaf None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.396581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c94678-47e3-4a66-bfa0-0c8ea7353aaf None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.397297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c94678-47e3-4a66-bfa0-0c8ea7353aaf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:32.398662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c94678-47e3-4a66-bfa0-0c8ea7353aaf None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:32.428887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8609e6b-25b8-41ef-aa0c-48cd769dff1c None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:32.470861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec842ad-0426-4e24-9e2a-35e815ebaacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:32.471736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec842ad-0426-4e24-9e2a-35e815ebaacd None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.472021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec842ad-0426-4e24-9e2a-35e815ebaacd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.472303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec842ad-0426-4e24-9e2a-35e815ebaacd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.480045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec842ad-0426-4e24-9e2a-35e815ebaacd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:32.481506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec842ad-0426-4e24-9e2a-35e815ebaacd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-5ec842ad-0426-4e24-9e2a-35e815ebaacd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:32.497390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:32.498393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:32.499649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 373/728] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Jun 17 08:33:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:32.500479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec842ad-0426-4e24-9e2a-35e815ebaacd None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:32.519905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 356/729] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:33:32 2022] POST /identity/v3/services => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:32.521051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94678-47e3-4a66-bfa0-0c8ea7353aaf None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:32.534632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:32.559175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:32.615048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec842ad-0426-4e24-9e2a-35e815ebaacd None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:32.658810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c94678-47e3-4a66-bfa0-0c8ea7353aaf None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:32.664380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21adb1-c0cc-445b-815e-ff6959989f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:32.665153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21adb1-c0cc-445b-815e-ff6959989f0a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.665503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21adb1-c0cc-445b-815e-ff6959989f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.665906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21adb1-c0cc-445b-815e-ff6959989f0a None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.666731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21adb1-c0cc-445b-815e-ff6959989f0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:32.667649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21adb1-c0cc-445b-815e-ff6959989f0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:32.669222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21adb1-c0cc-445b-815e-ff6959989f0a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:32.683135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 374/730] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:32.689847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233666cf-793d-4d03-ac8d-0f7209722974 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.690836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233666cf-793d-4d03-ac8d-0f7209722974 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.690836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233666cf-793d-4d03-ac8d-0f7209722974 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.692344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 375/731] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:32.692699 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233666cf-793d-4d03-ac8d-0f7209722974 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:32.701010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312beb0e-32b3-4928-9e6e-3a766ae60ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:32.701812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312beb0e-32b3-4928-9e6e-3a766ae60ccd None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.702188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312beb0e-32b3-4928-9e6e-3a766ae60ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.702563 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312beb0e-32b3-4928-9e6e-3a766ae60ccd None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.703414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312beb0e-32b3-4928-9e6e-3a766ae60ccd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:32.704997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312beb0e-32b3-4928-9e6e-3a766ae60ccd None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:32.771370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 357/732] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:33:32 2022] POST /identity/v3/services => generated 240 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:32.772409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312beb0e-32b3-4928-9e6e-3a766ae60ccd None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:32.787917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:32.815695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233666cf-793d-4d03-ac8d-0f7209722974 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:32.859312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b993e-c236-47e6-b3f3-20e3c2af577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:32.860046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b993e-c236-47e6-b3f3-20e3c2af577a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.860334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b993e-c236-47e6-b3f3-20e3c2af577a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.860617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b993e-c236-47e6-b3f3-20e3c2af577a None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.861507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b993e-c236-47e6-b3f3-20e3c2af577a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:32.861824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b993e-c236-47e6-b3f3-20e3c2af577a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:32.863574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b993e-c236-47e6-b3f3-20e3c2af577a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:32.885228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:32.886024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 376/733] 10.222.0.78 () {56 vars in 1149 bytes} [Fri Jun 17 08:33:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:32.887489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc521a02-eed1-4316-9fec-9f5df8be0054 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.887781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc521a02-eed1-4316-9fec-9f5df8be0054 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.888147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc521a02-eed1-4316-9fec-9f5df8be0054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.906987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-dc521a02-eed1-4316-9fec-9f5df8be0054 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:32.908243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-dc521a02-eed1-4316-9fec-9f5df8be0054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:32.913010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312beb0e-32b3-4928-9e6e-3a766ae60ccd None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:32.964126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548b092-a3bd-4b90-a5d4-b380959d54e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:32.964802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548b092-a3bd-4b90-a5d4-b380959d54e7 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:32.965089 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548b092-a3bd-4b90-a5d4-b380959d54e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:32.965363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548b092-a3bd-4b90-a5d4-b380959d54e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:32.966699 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548b092-a3bd-4b90-a5d4-b380959d54e7 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=6aa3618089794b938018ff2666afebe3) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:32.967015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548b092-a3bd-4b90-a5d4-b380959d54e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:32.968658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548b092-a3bd-4b90-a5d4-b380959d54e7 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:32.975127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 358/734] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:32 2022] GET /identity/v3/role_assignments?user.id=6aa3618089794b938018ff2666afebe3&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:32.976111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548b092-a3bd-4b90-a5d4-b380959d54e7 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:33.003705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 377/735] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:33.028622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc521a02-eed1-4316-9fec-9f5df8be0054 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:33.116504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548b092-a3bd-4b90-a5d4-b380959d54e7 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:33.122151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:33.165227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc521a02-eed1-4316-9fec-9f5df8be0054 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:33.168386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07498-c3bf-4840-834d-b8a06b59ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:33.169249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07498-c3bf-4840-834d-b8a06b59ee9c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:33.170235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07498-c3bf-4840-834d-b8a06b59ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:33.170653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07498-c3bf-4840-834d-b8a06b59ee9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:33.207301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac115950-f3cc-4a40-9dce-9a07e60807da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:33.208158 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115950-f3cc-4a40-9dce-9a07e60807da None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:33.208511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115950-f3cc-4a40-9dce-9a07e60807da None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:33.208798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115950-f3cc-4a40-9dce-9a07e60807da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:33.221767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac115950-f3cc-4a40-9dce-9a07e60807da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ac115950-f3cc-4a40-9dce-9a07e60807da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:33.230242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:33.231250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:33.232639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 378/736] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:33.242652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac115950-f3cc-4a40-9dce-9a07e60807da None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:33.327652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:33.434284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a07498-c3bf-4840-834d-b8a06b59ee9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:33.436882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a07498-c3bf-4840-834d-b8a06b59ee9c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:33.444077 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac115950-f3cc-4a40-9dce-9a07e60807da None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:33.527710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:33.540613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c6c5-1194-4a9b-8141-856b5f8a38b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:33.541294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c6c5-1194-4a9b-8141-856b5f8a38b7 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:33.541577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c6c5-1194-4a9b-8141-856b5f8a38b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:33.542973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c6c5-1194-4a9b-8141-856b5f8a38b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:33.542973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c6c5-1194-4a9b-8141-856b5f8a38b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:33.542973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c6c5-1194-4a9b-8141-856b5f8a38b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:33.544310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c6c5-1194-4a9b-8141-856b5f8a38b7 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:33.565907 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 379/737] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:33.570461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 359/738] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:33:33.571323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c6c5-1194-4a9b-8141-856b5f8a38b7 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:33.576620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07498-c3bf-4840-834d-b8a06b59ee9c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:33.625599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:33.681401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07498-c3bf-4840-834d-b8a06b59ee9c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:33.726824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796867-fe81-4c2f-b782-f629b7842e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:33.728079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796867-fe81-4c2f-b782-f629b7842e98 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:33.728558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796867-fe81-4c2f-b782-f629b7842e98 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:33.729022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796867-fe81-4c2f-b782-f629b7842e98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:33.743378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c6c5-1194-4a9b-8141-856b5f8a38b7 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:33.750011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac796867-fe81-4c2f-b782-f629b7842e98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:33.751790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac796867-fe81-4c2f-b782-f629b7842e98 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-ac796867-fe81-4c2f-b782-f629b7842e98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:33.779470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:33.780402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:33.781273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:33.781273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:33.781273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:33.781273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:33.783764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 360/739] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:33.788115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7007d59-8e36-45f6-81eb-0ca8f1a99a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:33.788885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7007d59-8e36-45f6-81eb-0ca8f1a99a39 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:33.789170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7007d59-8e36-45f6-81eb-0ca8f1a99a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:33.789446 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7007d59-8e36-45f6-81eb-0ca8f1a99a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:33.789838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796867-fe81-4c2f-b782-f629b7842e98 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:33.811261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7007d59-8e36-45f6-81eb-0ca8f1a99a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:33.812844 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7007d59-8e36-45f6-81eb-0ca8f1a99a39 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-a7007d59-8e36-45f6-81eb-0ca8f1a99a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:33.837415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:33.838762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:33.839672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:33.839672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:33.839672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:33.839672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:33.847817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 380/740] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:33.852846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7007d59-8e36-45f6-81eb-0ca8f1a99a39 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:33.905670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:33.911128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796867-fe81-4c2f-b782-f629b7842e98 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:33.940400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:33.986322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d20f9-3694-4773-a248-b480887cf43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:33.986996 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d20f9-3694-4773-a248-b480887cf43c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:33.987278 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d20f9-3694-4773-a248-b480887cf43c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:33.987584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d20f9-3694-4773-a248-b480887cf43c None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:33.988305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d20f9-3694-4773-a248-b480887cf43c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:33.988610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d20f9-3694-4773-a248-b480887cf43c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:33.989977 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d20f9-3694-4773-a248-b480887cf43c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:34.014584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 361/741] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:34.021145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d20f9-3694-4773-a248-b480887cf43c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:34.045576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7007d59-8e36-45f6-81eb-0ca8f1a99a39 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:34.105312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4f8fb-aba1-4148-af9e-9b2d348e735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:34.105981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4f8fb-aba1-4148-af9e-9b2d348e735b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:34.106264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4f8fb-aba1-4148-af9e-9b2d348e735b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:34.106541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4f8fb-aba1-4148-af9e-9b2d348e735b None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:34.108014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4f8fb-aba1-4148-af9e-9b2d348e735b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:34.108323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4f8fb-aba1-4148-af9e-9b2d348e735b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:34.109701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4f8fb-aba1-4148-af9e-9b2d348e735b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:34.122090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 381/742] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:34.128011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4f8fb-aba1-4148-af9e-9b2d348e735b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:34.196294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d20f9-3694-4773-a248-b480887cf43c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:34.269856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8044-b71c-4bc4-8310-9f1be4ed99ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:34.270587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8044-b71c-4bc4-8310-9f1be4ed99ed None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:34.270869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8044-b71c-4bc4-8310-9f1be4ed99ed None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:34.271146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8044-b71c-4bc4-8310-9f1be4ed99ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:34.285190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa8044-b71c-4bc4-8310-9f1be4ed99ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:34.286870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa8044-b71c-4bc4-8310-9f1be4ed99ed None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-12fa8044-b71c-4bc4-8310-9f1be4ed99ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:34.302347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:34.303258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:34.304185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:34.304185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:34.304185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:34.304185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:34.304185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:34.304185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:34.304185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:34.304185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:34.304185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 362/743] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:34.311304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8044-b71c-4bc4-8310-9f1be4ed99ed None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:34.345906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4f8fb-aba1-4148-af9e-9b2d348e735b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:34.349404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:34.359113 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:34.411858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13f82-bf7e-4eb6-b462-d37300e240f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:34.412713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13f82-bf7e-4eb6-b462-d37300e240f0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:34.412997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13f82-bf7e-4eb6-b462-d37300e240f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:34.413321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13f82-bf7e-4eb6-b462-d37300e240f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:34.421499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a13f82-bf7e-4eb6-b462-d37300e240f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:34.423585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a13f82-bf7e-4eb6-b462-d37300e240f0 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-59a13f82-bf7e-4eb6-b462-d37300e240f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:34.441535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:34.442547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:34.443500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 382/744] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:34.448875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13f82-bf7e-4eb6-b462-d37300e240f0 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:34.541600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8044-b71c-4bc4-8310-9f1be4ed99ed None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:34.565609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13f82-bf7e-4eb6-b462-d37300e240f0 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:34.603125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4f880-bdef-4772-a2d6-0e7f3b198333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:34.603911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4f880-bdef-4772-a2d6-0e7f3b198333 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:34.604348 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4f880-bdef-4772-a2d6-0e7f3b198333 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:34.604692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4f880-bdef-4772-a2d6-0e7f3b198333 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:34.605691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4f880-bdef-4772-a2d6-0e7f3b198333 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:34.606068 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4f880-bdef-4772-a2d6-0e7f3b198333 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:34.608535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4f880-bdef-4772-a2d6-0e7f3b198333 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:34.634872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fdc56-5dd5-4181-bd66-8186a099a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:34.635556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fdc56-5dd5-4181-bd66-8186a099a46a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:34.635837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fdc56-5dd5-4181-bd66-8186a099a46a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:34.636111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fdc56-5dd5-4181-bd66-8186a099a46a None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:34.636890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fdc56-5dd5-4181-bd66-8186a099a46a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:34.637194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fdc56-5dd5-4181-bd66-8186a099a46a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:34.639179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fdc56-5dd5-4181-bd66-8186a099a46a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:34.641018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 383/745] 10.222.0.78 () {56 vars in 1135 bytes} [Fri Jun 17 08:33:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:34.641906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4f880-bdef-4772-a2d6-0e7f3b198333 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:34.662019 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 363/746] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:34.668134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fdc56-5dd5-4181-bd66-8186a099a46a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:34.690553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:34.807873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:34.821079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4f880-bdef-4772-a2d6-0e7f3b198333 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:34.848320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fdc56-5dd5-4181-bd66-8186a099a46a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:34.881241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b496c-e619-46d7-b364-820ed2600ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:34.881914 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b496c-e619-46d7-b364-820ed2600ff4 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:34.882204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b496c-e619-46d7-b364-820ed2600ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:34.882481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b496c-e619-46d7-b364-820ed2600ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:34.934026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fcb29-d607-49af-becf-44794e7e662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:34.934693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fcb29-d607-49af-becf-44794e7e662f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:34.935012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fcb29-d607-49af-becf-44794e7e662f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:34.935287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fcb29-d607-49af-becf-44794e7e662f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:34.936140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fcb29-d607-49af-becf-44794e7e662f None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=7687888c51224d8e94018f35a82fbcc4) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:34.936450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fcb29-d607-49af-becf-44794e7e662f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:34.937883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fcb29-d607-49af-becf-44794e7e662f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:34.953113 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 364/747] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:34 2022] GET /identity/v3/role_assignments?user.id=7687888c51224d8e94018f35a82fbcc4&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:34.954561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ddf6-bc8a-489e-b4f5-257a6a3fd9e7 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:34.954856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ddf6-bc8a-489e-b4f5-257a6a3fd9e7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:34.955139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ddf6-bc8a-489e-b4f5-257a6a3fd9e7 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:34.960613 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 365/748] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:34.962275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64623bf-df40-42e2-88b2-5b100cc3ac7f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:34.962751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64623bf-df40-42e2-88b2-5b100cc3ac7f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:34.963181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64623bf-df40-42e2-88b2-5b100cc3ac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.001800 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b496c-e619-46d7-b364-820ed2600ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:35.005186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b496c-e619-46d7-b364-820ed2600ff4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:35.006595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-e64623bf-df40-42e2-88b2-5b100cc3ac7f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:35.008342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e64623bf-df40-42e2-88b2-5b100cc3ac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:35.032118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:35.132227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 366/749] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:35.179568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64623bf-df40-42e2-88b2-5b100cc3ac7f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:35.195993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 384/750] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:33:35.201905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b496c-e619-46d7-b364-820ed2600ff4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:35.282262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:35.345128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64623bf-df40-42e2-88b2-5b100cc3ac7f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:35.379616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b496c-e619-46d7-b364-820ed2600ff4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:35.413184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852a718-f398-4b89-aa75-342af467500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:35.413924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852a718-f398-4b89-aa75-342af467500e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:35.414198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852a718-f398-4b89-aa75-342af467500e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:35.414463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852a718-f398-4b89-aa75-342af467500e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.415116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852a718-f398-4b89-aa75-342af467500e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:35.416536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852a718-f398-4b89-aa75-342af467500e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:35.431538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-2852a718-f398-4b89-aa75-342af467500e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:35.437492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:35.438628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:35.439636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 367/751] 10.222.0.78 () {56 vars in 1129 bytes} [Fri Jun 17 08:33:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:35.446447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852a718-f398-4b89-aa75-342af467500e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:35.453079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4890201-0dc1-41cd-9de4-1a164991b68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:35.453965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4890201-0dc1-41cd-9de4-1a164991b68b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:35.454247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4890201-0dc1-41cd-9de4-1a164991b68b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:35.454520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4890201-0dc1-41cd-9de4-1a164991b68b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.467934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4890201-0dc1-41cd-9de4-1a164991b68b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:35.470147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4890201-0dc1-41cd-9de4-1a164991b68b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-d4890201-0dc1-41cd-9de4-1a164991b68b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:35.495836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:35.496993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:35.498161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:35.498161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:35.498161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:35.498161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:35.500618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 385/752] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:35.502169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057434aa-2cff-418a-b056-ac07484b601b None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:35.502596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057434aa-2cff-418a-b056-ac07484b601b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:35.503070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057434aa-2cff-418a-b056-ac07484b601b None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.509125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 386/753] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:35.509125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057434aa-2cff-418a-b056-ac07484b601b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:35.585028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852a718-f398-4b89-aa75-342af467500e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:35.621251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517e48a-2d9a-44bc-aee2-6551033cabec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:35.621922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517e48a-2d9a-44bc-aee2-6551033cabec None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:35.622210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517e48a-2d9a-44bc-aee2-6551033cabec None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:35.622738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517e48a-2d9a-44bc-aee2-6551033cabec None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.623469 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517e48a-2d9a-44bc-aee2-6551033cabec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:35.623779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517e48a-2d9a-44bc-aee2-6551033cabec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:35.625166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517e48a-2d9a-44bc-aee2-6551033cabec None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:35.626342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057434aa-2cff-418a-b056-ac07484b601b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:35.627253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:35.630549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 368/754] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Jun 17 08:33:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:35.631734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526716c-bcbc-429e-8bed-0fb4714512ae None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:35.632021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526716c-bcbc-429e-8bed-0fb4714512ae None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:35.632298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526716c-bcbc-429e-8bed-0fb4714512ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.654306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-1526716c-bcbc-429e-8bed-0fb4714512ae None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:35.656312 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1526716c-bcbc-429e-8bed-0fb4714512ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:35.667824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ff5e3-b6d9-45a8-8170-db8974e9a032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:35.668613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff5e3-b6d9-45a8-8170-db8974e9a032 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:35.668726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff5e3-b6d9-45a8-8170-db8974e9a032 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:35.668970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff5e3-b6d9-45a8-8170-db8974e9a032 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.669725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ff5e3-b6d9-45a8-8170-db8974e9a032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:35.670033 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ff5e3-b6d9-45a8-8170-db8974e9a032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:35.671425 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ff5e3-b6d9-45a8-8170-db8974e9a032 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:35.682692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 387/755] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:35.683968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d5bc-e73f-435a-ab0d-645862682ab5 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:35.684327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d5bc-e73f-435a-ab0d-645862682ab5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:35.684535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d5bc-e73f-435a-ab0d-645862682ab5 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.686111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 388/756] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:35.686991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d5bc-e73f-435a-ab0d-645862682ab5 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:35.725970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:35.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 369/757] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:35.743528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526716c-bcbc-429e-8bed-0fb4714512ae None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:35.807243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d5bc-e73f-435a-ab0d-645862682ab5 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:35.845180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53839a32-7d6e-4edf-916c-f0be80851715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:35.845850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53839a32-7d6e-4edf-916c-f0be80851715 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:35.845976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526716c-bcbc-429e-8bed-0fb4714512ae None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:35.846142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53839a32-7d6e-4edf-916c-f0be80851715 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:35.846406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53839a32-7d6e-4edf-916c-f0be80851715 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.847227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53839a32-7d6e-4edf-916c-f0be80851715 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:35.847567 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53839a32-7d6e-4edf-916c-f0be80851715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:35.849081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53839a32-7d6e-4edf-916c-f0be80851715 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:35.859173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 389/758] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Jun 17 08:33:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:35.860596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44370e11-6950-4526-aef9-d5cf297f4486 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:35.860896 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44370e11-6950-4526-aef9-d5cf297f4486 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:35.861173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44370e11-6950-4526-aef9-d5cf297f4486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.876804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:35.877960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-44370e11-6950-4526-aef9-d5cf297f4486 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:35.879147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-44370e11-6950-4526-aef9-d5cf297f4486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:35.883306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971b869-6b6e-44cc-abc4-fafe3c38e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:35.884120 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971b869-6b6e-44cc-abc4-fafe3c38e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:35.884399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971b869-6b6e-44cc-abc4-fafe3c38e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:35.884668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971b869-6b6e-44cc-abc4-fafe3c38e3f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:35.892485 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971b869-6b6e-44cc-abc4-fafe3c38e3f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:35.894020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971b869-6b6e-44cc-abc4-fafe3c38e3f4 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-9971b869-6b6e-44cc-abc4-fafe3c38e3f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:35.907867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:35.908790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:35.909877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:35.909877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:35.909877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:35.909877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:35.909877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:35.909877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:35.909877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:35.909877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:35.909877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 370/759] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:35.910437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971b869-6b6e-44cc-abc4-fafe3c38e3f4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:35.959120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 390/760] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:35.964214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44370e11-6950-4526-aef9-d5cf297f4486 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:35.996361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:36.020361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971b869-6b6e-44cc-abc4-fafe3c38e3f4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:36.054709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cf800-009a-48a0-8e12-1069dccf9b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:36.055524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cf800-009a-48a0-8e12-1069dccf9b1c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.055808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cf800-009a-48a0-8e12-1069dccf9b1c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.056085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cf800-009a-48a0-8e12-1069dccf9b1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.066983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cf800-009a-48a0-8e12-1069dccf9b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:36.071472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44370e11-6950-4526-aef9-d5cf297f4486 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-696cf800-009a-48a0-8e12-1069dccf9b1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:36.074564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:36.076381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:36.077340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:36.081684 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 371/761] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:36.082459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cf800-009a-48a0-8e12-1069dccf9b1c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:36.109275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325b16d-ac42-48f5-9985-441fed150219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:36.109938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325b16d-ac42-48f5-9985-441fed150219 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.110231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325b16d-ac42-48f5-9985-441fed150219 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.110495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325b16d-ac42-48f5-9985-441fed150219 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.111276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325b16d-ac42-48f5-9985-441fed150219 None admin] RBAC: Adding query filter params (interface=public, service_id=e6b0734bdcd84b219b20295738252878, region_id=RegionOne) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:36.111616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325b16d-ac42-48f5-9985-441fed150219 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:36.112983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325b16d-ac42-48f5-9985-441fed150219 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:36.125347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 391/762] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Jun 17 08:33:35 2022] GET /identity/v3/endpoints?service_id=e6b0734bdcd84b219b20295738252878&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:36.125347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325b16d-ac42-48f5-9985-441fed150219 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:36.137342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:36.191667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cf800-009a-48a0-8e12-1069dccf9b1c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:36.218947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:36.227973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325b16d-ac42-48f5-9985-441fed150219 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:36.232378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c351d-a177-4d19-89cd-883b1de0a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:36.232378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c351d-a177-4d19-89cd-883b1de0a30f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.232378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c351d-a177-4d19-89cd-883b1de0a30f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.232378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c351d-a177-4d19-89cd-883b1de0a30f None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.233325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c351d-a177-4d19-89cd-883b1de0a30f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:36.233690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c351d-a177-4d19-89cd-883b1de0a30f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:36.235214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c351d-a177-4d19-89cd-883b1de0a30f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:36.248706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 372/763] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:36.249534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c351d-a177-4d19-89cd-883b1de0a30f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:36.270209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800004a-b31f-455a-972c-ebc5504600d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:36.271015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800004a-b31f-455a-972c-ebc5504600d2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.271300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800004a-b31f-455a-972c-ebc5504600d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.271618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800004a-b31f-455a-972c-ebc5504600d2 None admin] PATH_INFO: `/v3/services/network` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.272278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800004a-b31f-455a-972c-ebc5504600d2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:36.273653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800004a-b31f-455a-972c-ebc5504600d2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-7800004a-b31f-455a-972c-ebc5504600d2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:36.285434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:36.286417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:36.287240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 392/764] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:36.288646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800004a-b31f-455a-972c-ebc5504600d2 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:36.361687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c351d-a177-4d19-89cd-883b1de0a30f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:36.373574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:36.392119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800004a-b31f-455a-972c-ebc5504600d2 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:36.397175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40537-9815-4ff9-96fd-524ee7559676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:36.398131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40537-9815-4ff9-96fd-524ee7559676 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.398607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40537-9815-4ff9-96fd-524ee7559676 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.399194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40537-9815-4ff9-96fd-524ee7559676 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.400013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab40537-9815-4ff9-96fd-524ee7559676 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:36.400320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab40537-9815-4ff9-96fd-524ee7559676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:36.401795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab40537-9815-4ff9-96fd-524ee7559676 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:36.415695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 373/765] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:36.416376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40537-9815-4ff9-96fd-524ee7559676 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:36.427790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebabaaf-4af8-4987-a2df-077e27637f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:36.428453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebabaaf-4af8-4987-a2df-077e27637f36 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.428742 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebabaaf-4af8-4987-a2df-077e27637f36 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.429028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebabaaf-4af8-4987-a2df-077e27637f36 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.429715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebabaaf-4af8-4987-a2df-077e27637f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:36.431077 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebabaaf-4af8-4987-a2df-077e27637f36 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:36.437061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 393/766] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3/services => generated 772 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:36.437835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebabaaf-4af8-4987-a2df-077e27637f36 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:36.484598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:36.549748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40537-9815-4ff9-96fd-524ee7559676 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:36.592030 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7f816-5937-48d4-bcb9-ee1a0920bdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:36.593107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7f816-5937-48d4-bcb9-ee1a0920bdff None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.593647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7f816-5937-48d4-bcb9-ee1a0920bdff None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.594102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7f816-5937-48d4-bcb9-ee1a0920bdff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.595119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7f816-5937-48d4-bcb9-ee1a0920bdff None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=46e2b769ba9b46778c96b2a04d45612d) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:36.595753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7f816-5937-48d4-bcb9-ee1a0920bdff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:36.597510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7f816-5937-48d4-bcb9-ee1a0920bdff None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:36.599392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebabaaf-4af8-4987-a2df-077e27637f36 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:36.609630 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 374/767] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3/role_assignments?user.id=46e2b769ba9b46778c96b2a04d45612d&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:36.610932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7f816-5937-48d4-bcb9-ee1a0920bdff None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:36.648725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0c7e6-dae2-4361-b549-af44fa56ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:36.650593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0c7e6-dae2-4361-b549-af44fa56ac13 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.650593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0c7e6-dae2-4361-b549-af44fa56ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.650593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0c7e6-dae2-4361-b549-af44fa56ac13 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.651172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0c7e6-dae2-4361-b549-af44fa56ac13 None admin] RBAC: Adding query filter params (name=network) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:36.651507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0c7e6-dae2-4361-b549-af44fa56ac13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:36.653207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0c7e6-dae2-4361-b549-af44fa56ac13 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:36.660342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 394/768] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:36.662991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:36.665386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0c7e6-dae2-4361-b549-af44fa56ac13 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:36.748072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7f816-5937-48d4-bcb9-ee1a0920bdff None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:36.787309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:36.798486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958df17-dfb5-4373-b85d-599e3f0b612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:36.799292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958df17-dfb5-4373-b85d-599e3f0b612c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.799712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958df17-dfb5-4373-b85d-599e3f0b612c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.799885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958df17-dfb5-4373-b85d-599e3f0b612c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.807285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0c7e6-dae2-4361-b549-af44fa56ac13 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:36.811832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958df17-dfb5-4373-b85d-599e3f0b612c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:36.812911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958df17-dfb5-4373-b85d-599e3f0b612c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-7958df17-dfb5-4373-b85d-599e3f0b612c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:36.836894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:36.837858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:36.839024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:36.839024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:36.839024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:36.839024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:36.839024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 375/769] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:36.844558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958df17-dfb5-4373-b85d-599e3f0b612c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:36.854520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb1d63-da81-49b3-abb6-8c24c259c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:36.855868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb1d63-da81-49b3-abb6-8c24c259c338 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:36.856294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb1d63-da81-49b3-abb6-8c24c259c338 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:36.856819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb1d63-da81-49b3-abb6-8c24c259c338 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:36.858719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb1d63-da81-49b3-abb6-8c24c259c338 None admin] RBAC: Adding query filter params (type=network) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:36.859185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb1d63-da81-49b3-abb6-8c24c259c338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:36.861098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb1d63-da81-49b3-abb6-8c24c259c338 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:36.868462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 395/770] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:36.876489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb1d63-da81-49b3-abb6-8c24c259c338 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:36.967876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:37.004589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb1d63-da81-49b3-abb6-8c24c259c338 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:37.009296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958df17-dfb5-4373-b85d-599e3f0b612c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:37.046141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079a23b-6706-4d05-bd9b-bd873d065430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:37.047071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079a23b-6706-4d05-bd9b-bd873d065430 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:37.047553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079a23b-6706-4d05-bd9b-bd873d065430 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:37.048102 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079a23b-6706-4d05-bd9b-bd873d065430 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:37.049274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079a23b-6706-4d05-bd9b-bd873d065430 None admin] RBAC: Adding query filter params (interface=public, service_id=0c4023cf2a0443ff8c79ee958623cc03, region_id=RegionOne) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:37.049749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079a23b-6706-4d05-bd9b-bd873d065430 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:37.051262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079a23b-6706-4d05-bd9b-bd873d065430 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:37.058244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 396/771] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3/endpoints?service_id=0c4023cf2a0443ff8c79ee958623cc03&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:37.063916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079a23b-6706-4d05-bd9b-bd873d065430 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:37.080630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:37.108880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea652b-e25e-4938-a437-630af93db456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:37.109696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea652b-e25e-4938-a437-630af93db456 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:37.109990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea652b-e25e-4938-a437-630af93db456 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:37.110269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea652b-e25e-4938-a437-630af93db456 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:37.110990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea652b-e25e-4938-a437-630af93db456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:37.111298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea652b-e25e-4938-a437-630af93db456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:37.112760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea652b-e25e-4938-a437-630af93db456 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:37.135366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 376/772] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:37.140755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea652b-e25e-4938-a437-630af93db456 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:37.178744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079a23b-6706-4d05-bd9b-bd873d065430 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:37.216297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d44b7-3cdb-48ff-b187-953939d86029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:37.217343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d44b7-3cdb-48ff-b187-953939d86029 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:37.217887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d44b7-3cdb-48ff-b187-953939d86029 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:37.218364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d44b7-3cdb-48ff-b187-953939d86029 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:37.219292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d44b7-3cdb-48ff-b187-953939d86029 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:37.220988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d44b7-3cdb-48ff-b187-953939d86029 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:37.227304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 397/773] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Jun 17 08:33:37 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:37.317017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea652b-e25e-4938-a437-630af93db456 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:37.328663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68325-7ae3-438b-90bf-e8b69e1cd7a3 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:37.329331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68325-7ae3-438b-90bf-e8b69e1cd7a3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:37.329812 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe68325-7ae3-438b-90bf-e8b69e1cd7a3 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:37.331449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 398/774] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:33:37.338290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955ef51-5363-4d64-9aea-689284386243 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:37.338586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955ef51-5363-4d64-9aea-689284386243 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:37.338861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955ef51-5363-4d64-9aea-689284386243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:37.366591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82582a57-b272-4ea6-9aff-c1b92808c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:37.367770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82582a57-b272-4ea6-9aff-c1b92808c827 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:37.368355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82582a57-b272-4ea6-9aff-c1b92808c827 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:37.368843 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82582a57-b272-4ea6-9aff-c1b92808c827 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:37.373008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-7955ef51-5363-4d64-9aea-689284386243 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:37.374234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7955ef51-5363-4d64-9aea-689284386243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:37.379178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82582a57-b272-4ea6-9aff-c1b92808c827 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:37.382123 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82582a57-b272-4ea6-9aff-c1b92808c827 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-82582a57-b272-4ea6-9aff-c1b92808c827 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:37.400006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:37.401116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:37.402075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:37.402075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:37.402075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:37.402075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:37.402075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:37.402075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:37.402075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:37.402075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:37.402075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:37.402075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:37.405746 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 377/775] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Jun 17 08:33:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:37.411111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82582a57-b272-4ea6-9aff-c1b92808c827 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:37.434700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:37.509427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 399/776] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:37.532051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955ef51-5363-4d64-9aea-689284386243 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:37.544741 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:37.580954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82582a57-b272-4ea6-9aff-c1b92808c827 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:37.628623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e85aa-2bb3-4ed2-80b6-0796ec475f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:37.630208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e85aa-2bb3-4ed2-80b6-0796ec475f03 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:37.630500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e85aa-2bb3-4ed2-80b6-0796ec475f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:37.630779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e85aa-2bb3-4ed2-80b6-0796ec475f03 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:37.631686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e85aa-2bb3-4ed2-80b6-0796ec475f03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:37.631994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e85aa-2bb3-4ed2-80b6-0796ec475f03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:37.633421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e85aa-2bb3-4ed2-80b6-0796ec475f03 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:37.654492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 378/777] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Jun 17 08:33:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:37.659567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e85aa-2bb3-4ed2-80b6-0796ec475f03 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:37.687862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955ef51-5363-4d64-9aea-689284386243 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:37.729515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4192c1-9dc0-4bfe-99d1-f426f262b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:37.730553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4192c1-9dc0-4bfe-99d1-f426f262b05f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:37.730838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4192c1-9dc0-4bfe-99d1-f426f262b05f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:37.731115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4192c1-9dc0-4bfe-99d1-f426f262b05f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:37.743239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4192c1-9dc0-4bfe-99d1-f426f262b05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-0b4192c1-9dc0-4bfe-99d1-f426f262b05f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:37.752674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:37.753624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:37.754457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 400/778] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:37.759715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4192c1-9dc0-4bfe-99d1-f426f262b05f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:37.834338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:37.836502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:37.874590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4192c1-9dc0-4bfe-99d1-f426f262b05f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:37.916252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c321108-114b-43ad-804f-008afd7a3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:37.916939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321108-114b-43ad-804f-008afd7a3917 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:37.917224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321108-114b-43ad-804f-008afd7a3917 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:37.917503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321108-114b-43ad-804f-008afd7a3917 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:37.918616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c321108-114b-43ad-804f-008afd7a3917 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:37.918926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c321108-114b-43ad-804f-008afd7a3917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:37.923383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c321108-114b-43ad-804f-008afd7a3917 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:37.926887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e85aa-2bb3-4ed2-80b6-0796ec475f03 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:37.931649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 401/779] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:37.940788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c321108-114b-43ad-804f-008afd7a3917 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:37.989153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fe52b-12a4-476d-87a5-36d7e56361bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:37.990270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fe52b-12a4-476d-87a5-36d7e56361bf None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:37.990772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fe52b-12a4-476d-87a5-36d7e56361bf None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:37.991191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fe52b-12a4-476d-87a5-36d7e56361bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:38.004084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fe52b-12a4-476d-87a5-36d7e56361bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:38.006774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fe52b-12a4-476d-87a5-36d7e56361bf None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-8a5fe52b-12a4-476d-87a5-36d7e56361bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:38.026997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:38.028204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:38.029898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:38.029898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:38.029898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:38.029898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:38.032447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 379/780] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:38.037741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fe52b-12a4-476d-87a5-36d7e56361bf None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:38.142311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c321108-114b-43ad-804f-008afd7a3917 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:38.163110 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fe52b-12a4-476d-87a5-36d7e56361bf None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:38.195738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:38.200475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:38.212635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d2e1a-d4f1-401d-aaa0-fcc7933353cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:38.213297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2e1a-d4f1-401d-aaa0-fcc7933353cf None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:38.213582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2e1a-d4f1-401d-aaa0-fcc7933353cf None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:38.213863 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d2e1a-d4f1-401d-aaa0-fcc7933353cf None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:38.214586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d2e1a-d4f1-401d-aaa0-fcc7933353cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:38.214893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d2e1a-d4f1-401d-aaa0-fcc7933353cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:38.217689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d2e1a-d4f1-401d-aaa0-fcc7933353cf None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:38.219677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf24d6-253b-4aae-8a7f-10e9fc0990d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:38.220523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf24d6-253b-4aae-8a7f-10e9fc0990d5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:38.220842 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf24d6-253b-4aae-8a7f-10e9fc0990d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:38.221126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf24d6-253b-4aae-8a7f-10e9fc0990d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:38.239978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf24d6-253b-4aae-8a7f-10e9fc0990d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:38.241447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf24d6-253b-4aae-8a7f-10e9fc0990d5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:38.244456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 380/781] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:38.249999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d2e1a-d4f1-401d-aaa0-fcc7933353cf None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-25bf24d6-253b-4aae-8a7f-10e9fc0990d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:38.277937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:38.279599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:38.280830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:38.280830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:38.280830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:38.280830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:38.283392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 402/782] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:38.292989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf24d6-253b-4aae-8a7f-10e9fc0990d5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:38.443156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d2e1a-d4f1-401d-aaa0-fcc7933353cf None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:38.473930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf24d6-253b-4aae-8a7f-10e9fc0990d5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:38.510973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2fd2f-b411-4066-98d0-973e7f20e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:38.512063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2fd2f-b411-4066-98d0-973e7f20e7ab None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:38.512343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2fd2f-b411-4066-98d0-973e7f20e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:38.512617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2fd2f-b411-4066-98d0-973e7f20e7ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:38.525526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2fd2f-b411-4066-98d0-973e7f20e7ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:38.526975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2fd2f-b411-4066-98d0-973e7f20e7ab None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:38.529438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da78be7-68f0-4576-931d-a0d9dd92849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:38.530100 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da78be7-68f0-4576-931d-a0d9dd92849f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:38.530380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da78be7-68f0-4576-931d-a0d9dd92849f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:38.530655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da78be7-68f0-4576-931d-a0d9dd92849f None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:38.531391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da78be7-68f0-4576-931d-a0d9dd92849f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:38.531696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da78be7-68f0-4576-931d-a0d9dd92849f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:38.533052 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da78be7-68f0-4576-931d-a0d9dd92849f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-67f2fd2f-b411-4066-98d0-973e7f20e7ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:38.549365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:38.550305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:38.551187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:38.551187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:38.551187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:38.551187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:38.551187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:38.551187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:38.551187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:38.551187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:38.559879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 381/783] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:38.565504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 403/784] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:38.565938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2fd2f-b411-4066-98d0-973e7f20e7ab None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:38.570656 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da78be7-68f0-4576-931d-a0d9dd92849f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:38.626243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:38.686128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:38.696767 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2fd2f-b411-4066-98d0-973e7f20e7ab None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:38.735640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4321c5-f8df-49ee-8665-d49e3ae6f079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:38.736417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4321c5-f8df-49ee-8665-d49e3ae6f079 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:38.736702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4321c5-f8df-49ee-8665-d49e3ae6f079 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:38.736978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4321c5-f8df-49ee-8665-d49e3ae6f079 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:38.737762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4321c5-f8df-49ee-8665-d49e3ae6f079 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:38.738073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4321c5-f8df-49ee-8665-d49e3ae6f079 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:38.741817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4321c5-f8df-49ee-8665-d49e3ae6f079 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:38.755758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 382/785] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:38.761837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4321c5-f8df-49ee-8665-d49e3ae6f079 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:38.803002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da78be7-68f0-4576-931d-a0d9dd92849f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:38.869816 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585f297-afcf-4cbc-b5cb-ea6bd6165b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:38.870630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585f297-afcf-4cbc-b5cb-ea6bd6165b01 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:38.870910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585f297-afcf-4cbc-b5cb-ea6bd6165b01 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:38.871182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585f297-afcf-4cbc-b5cb-ea6bd6165b01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:38.882570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585f297-afcf-4cbc-b5cb-ea6bd6165b01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:38.884046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585f297-afcf-4cbc-b5cb-ea6bd6165b01 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-a585f297-afcf-4cbc-b5cb-ea6bd6165b01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:38.908736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:38.909733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:38.910668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:38.910668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:38.910668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:38.910668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:38.910668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:38.910668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:38.910668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:38.910668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:38.910668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:38.910668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:38.918841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 404/786] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Jun 17 08:33:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:38.924474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585f297-afcf-4cbc-b5cb-ea6bd6165b01 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:38.948954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:38.955704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4321c5-f8df-49ee-8665-d49e3ae6f079 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:39.015654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aa80e-9c71-4ca8-bd86-46dd57191eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:39.016545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aa80e-9c71-4ca8-bd86-46dd57191eb4 None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.016824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aa80e-9c71-4ca8-bd86-46dd57191eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.017099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aa80e-9c71-4ca8-bd86-46dd57191eb4 None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/6aa3618089794b938018ff2666afebe3/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.020442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6aa80e-9c71-4ca8-bd86-46dd57191eb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=6aa3618089794b938018ff2666afebe3, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:39.022754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6aa80e-9c71-4ca8-bd86-46dd57191eb4 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:39.075848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:39.079056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585f297-afcf-4cbc-b5cb-ea6bd6165b01 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:39.113267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 383/787] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:33:38 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/6aa3618089794b938018ff2666afebe3/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:33:39.134334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313de565-1671-4830-886c-cb5bb015c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:39.135026 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de565-1671-4830-886c-cb5bb015c114 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.135310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de565-1671-4830-886c-cb5bb015c114 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.135610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313de565-1671-4830-886c-cb5bb015c114 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.136466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313de565-1671-4830-886c-cb5bb015c114 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:39.136780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313de565-1671-4830-886c-cb5bb015c114 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:39.138302 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313de565-1671-4830-886c-cb5bb015c114 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:39.158231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 405/788] 10.222.0.78 () {56 vars in 1149 bytes} [Fri Jun 17 08:33:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:39.163508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aa80e-9c71-4ca8-bd86-46dd57191eb4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:39.165955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b026f4-e6ee-4631-b0f5-9cba1216eb88 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.166443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b026f4-e6ee-4631-b0f5-9cba1216eb88 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.166929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b026f4-e6ee-4631-b0f5-9cba1216eb88 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.168783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 406/789] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:33:39.177348 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f0f6-8f06-40da-af51-da60b099c67b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.178066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f0f6-8f06-40da-af51-da60b099c67b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.178502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f0f6-8f06-40da-af51-da60b099c67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.197589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f105f0f6-8f06-40da-af51-da60b099c67b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:39.199146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f105f0f6-8f06-40da-af51-da60b099c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:39.284200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 407/790] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:39.311384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105f0f6-8f06-40da-af51-da60b099c67b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:39.387472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aa80e-9c71-4ca8-bd86-46dd57191eb4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:39.431534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:39.439997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899975a1-cb05-4bea-831c-e01802d69e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:39.440893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899975a1-cb05-4bea-831c-e01802d69e47 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.441249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899975a1-cb05-4bea-831c-e01802d69e47 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.441598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899975a1-cb05-4bea-831c-e01802d69e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.445397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105f0f6-8f06-40da-af51-da60b099c67b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:39.454381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899975a1-cb05-4bea-831c-e01802d69e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:39.455887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899975a1-cb05-4bea-831c-e01802d69e47 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-899975a1-cb05-4bea-831c-e01802d69e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:39.475330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:39.476303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:39.477598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:39.477598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:39.477598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:39.477598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:39.477598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 384/791] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:39.478238 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43331-825f-48f5-85ce-d260c229e278 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.478529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43331-825f-48f5-85ce-d260c229e278 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.481734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43331-825f-48f5-85ce-d260c229e278 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.483594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 385/792] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:39.486504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c23b-30f9-454d-a2fe-556bfe8f4fa5 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.486690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c23b-30f9-454d-a2fe-556bfe8f4fa5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.486937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c23b-30f9-454d-a2fe-556bfe8f4fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.489822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77eafc2-88d2-4fb9-9160-2eda3b0d3cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:39.490832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77eafc2-88d2-4fb9-9160-2eda3b0d3cfa None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.491305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77eafc2-88d2-4fb9-9160-2eda3b0d3cfa None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.491703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77eafc2-88d2-4fb9-9160-2eda3b0d3cfa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.492464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77eafc2-88d2-4fb9-9160-2eda3b0d3cfa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:39.493961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77eafc2-88d2-4fb9-9160-2eda3b0d3cfa None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:39.505759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ea62c23b-30f9-454d-a2fe-556bfe8f4fa5 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:39.506951 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ea62c23b-30f9-454d-a2fe-556bfe8f4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-e77eafc2-88d2-4fb9-9160-2eda3b0d3cfa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:39.507549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:39.508638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 08:33:39.509457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:39.510256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 408/793] 10.222.0.78 () {56 vars in 1129 bytes} [Fri Jun 17 08:33:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:39.510331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:39.515372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77eafc2-88d2-4fb9-9160-2eda3b0d3cfa None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:39.595559 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 386/794] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:39.596538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c23b-30f9-454d-a2fe-556bfe8f4fa5 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:39.621776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77eafc2-88d2-4fb9-9160-2eda3b0d3cfa None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:39.658265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2ca4b-70b7-44fb-91a5-8317b7f8d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:39.659065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ca4b-70b7-44fb-91a5-8317b7f8d524 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.659462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ca4b-70b7-44fb-91a5-8317b7f8d524 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.659817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ca4b-70b7-44fb-91a5-8317b7f8d524 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.660647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2ca4b-70b7-44fb-91a5-8317b7f8d524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:39.661028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2ca4b-70b7-44fb-91a5-8317b7f8d524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:39.662535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2ca4b-70b7-44fb-91a5-8317b7f8d524 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:39.678226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 409/795] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:39.679388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2ca4b-70b7-44fb-91a5-8317b7f8d524 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:39.701464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:39.731777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c23b-30f9-454d-a2fe-556bfe8f4fa5 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:39.770126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7f148-89a4-40c1-a404-3489d60b7449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:39.770802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7f148-89a4-40c1-a404-3489d60b7449 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.771090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7f148-89a4-40c1-a404-3489d60b7449 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.771387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7f148-89a4-40c1-a404-3489d60b7449 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.772100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7f148-89a4-40c1-a404-3489d60b7449 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:39.772408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7f148-89a4-40c1-a404-3489d60b7449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:39.773779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7f148-89a4-40c1-a404-3489d60b7449 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:39.778528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 387/796] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Jun 17 08:33:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:39.779742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7f148-89a4-40c1-a404-3489d60b7449 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:39.783941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:39.802051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2ca4b-70b7-44fb-91a5-8317b7f8d524 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:39.844894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa8334-4782-4ab9-84bb-45d5b67278d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:39.845841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8334-4782-4ab9-84bb-45d5b67278d2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.846451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8334-4782-4ab9-84bb-45d5b67278d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.846865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa8334-4782-4ab9-84bb-45d5b67278d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.858459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa8334-4782-4ab9-84bb-45d5b67278d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-27fa8334-4782-4ab9-84bb-45d5b67278d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:39.866105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:39.867202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:39.868200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 410/797] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:39.868981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b61dc-e202-4073-8371-172b7bb3e435 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.869559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b61dc-e202-4073-8371-172b7bb3e435 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.869559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b61dc-e202-4073-8371-172b7bb3e435 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.870924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 411/798] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:39.876201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b61dc-e202-4073-8371-172b7bb3e435 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:39.892181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7f148-89a4-40c1-a404-3489d60b7449 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:39.929220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4d277-b3f3-42a8-926c-b912f9882c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:39.930238 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4d277-b3f3-42a8-926c-b912f9882c96 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:39.930363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4d277-b3f3-42a8-926c-b912f9882c96 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:39.930583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4d277-b3f3-42a8-926c-b912f9882c96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:39.939070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4d277-b3f3-42a8-926c-b912f9882c96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:39.940561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4d277-b3f3-42a8-926c-b912f9882c96 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-9ac4d277-b3f3-42a8-926c-b912f9882c96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:39.956198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:39.957152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:39.958070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:39.958070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:39.958070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:39.958070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:39.958070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:39.958070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:39.958070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:39.958070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:39.958070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 388/799] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:39.958551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4d277-b3f3-42a8-926c-b912f9882c96 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:39.966833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:40.000556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b61dc-e202-4073-8371-172b7bb3e435 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:40.031511 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:40.036860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b89f7-ca7d-412e-b26b-6f424f83c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:40.037529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b89f7-ca7d-412e-b26b-6f424f83c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:40.037810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b89f7-ca7d-412e-b26b-6f424f83c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:40.054000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b89f7-ca7d-412e-b26b-6f424f83c6f2 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:40.054000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b89f7-ca7d-412e-b26b-6f424f83c6f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:40.054000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b89f7-ca7d-412e-b26b-6f424f83c6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:40.054000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b89f7-ca7d-412e-b26b-6f424f83c6f2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:40.054000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 412/800] 10.222.0.78 () {56 vars in 1124 bytes} [Fri Jun 17 08:33:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:40.054000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47709c8-8466-4827-b886-a0ebf82f770b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:40.054453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47709c8-8466-4827-b886-a0ebf82f770b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:40.054453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47709c8-8466-4827-b886-a0ebf82f770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:40.066765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f47709c8-8466-4827-b886-a0ebf82f770b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:40.067986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f47709c8-8466-4827-b886-a0ebf82f770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:40.076364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4d277-b3f3-42a8-926c-b912f9882c96 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:40.112398 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d33671-34a0-4c65-ae21-6e09b41e9150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:40.113075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d33671-34a0-4c65-ae21-6e09b41e9150 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:40.113380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d33671-34a0-4c65-ae21-6e09b41e9150 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:40.113617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d33671-34a0-4c65-ae21-6e09b41e9150 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:40.114357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d33671-34a0-4c65-ae21-6e09b41e9150 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:40.114665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d33671-34a0-4c65-ae21-6e09b41e9150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:40.116069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d33671-34a0-4c65-ae21-6e09b41e9150 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:40.126651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 389/801] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:40.128773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d33671-34a0-4c65-ae21-6e09b41e9150 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:40.141440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 413/802] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:40.144228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47709c8-8466-4827-b886-a0ebf82f770b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:40.224183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:40.256913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d33671-34a0-4c65-ae21-6e09b41e9150 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:40.261458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47709c8-8466-4827-b886-a0ebf82f770b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:40.291129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:40.301135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929220-1fcc-4887-8ac9-c6f31421652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:40.305514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929220-1fcc-4887-8ac9-c6f31421652e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:40.305514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929220-1fcc-4887-8ac9-c6f31421652e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:40.305514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929220-1fcc-4887-8ac9-c6f31421652e None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:40.305514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68929220-1fcc-4887-8ac9-c6f31421652e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:40.305514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68929220-1fcc-4887-8ac9-c6f31421652e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:40.305514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68929220-1fcc-4887-8ac9-c6f31421652e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:40.308224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e10417-854b-4d15-8e5c-0d1d95829bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:40.309015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e10417-854b-4d15-8e5c-0d1d95829bd3 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:40.309305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e10417-854b-4d15-8e5c-0d1d95829bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:40.309582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e10417-854b-4d15-8e5c-0d1d95829bd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:40.311027 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e10417-854b-4d15-8e5c-0d1d95829bd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:40.312459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e10417-854b-4d15-8e5c-0d1d95829bd3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:40.322660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 390/803] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:40.322660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929220-1fcc-4887-8ac9-c6f31421652e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:40.424670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929220-1fcc-4887-8ac9-c6f31421652e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:40.431588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 414/804] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Jun 17 08:33:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:40.431588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e10417-854b-4d15-8e5c-0d1d95829bd3 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:40.514444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9d203-0ca5-4ae5-80b2-f83fffb7e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:40.516017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9d203-0ca5-4ae5-80b2-f83fffb7e874 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:40.517017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9d203-0ca5-4ae5-80b2-f83fffb7e874 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:40.517800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9d203-0ca5-4ae5-80b2-f83fffb7e874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:40.534124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9d203-0ca5-4ae5-80b2-f83fffb7e874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:40.536812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9d203-0ca5-4ae5-80b2-f83fffb7e874 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:40.560491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e10417-854b-4d15-8e5c-0d1d95829bd3 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-bed9d203-0ca5-4ae5-80b2-f83fffb7e874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:40.564495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:40.565424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:40.566329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:40.566329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:40.566329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:40.566329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:40.567931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 391/805] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:40.569088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9d203-0ca5-4ae5-80b2-f83fffb7e874 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:40.596382 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:40.610777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:40.615193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648683c-6f8c-42b5-83ba-eab7f40a7d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:40.616247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648683c-6f8c-42b5-83ba-eab7f40a7d55 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:40.616711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648683c-6f8c-42b5-83ba-eab7f40a7d55 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:40.617167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648683c-6f8c-42b5-83ba-eab7f40a7d55 None admin] PATH_INFO: `/v3/services/network` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:40.618018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648683c-6f8c-42b5-83ba-eab7f40a7d55 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:40.620047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648683c-6f8c-42b5-83ba-eab7f40a7d55 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-7648683c-6f8c-42b5-83ba-eab7f40a7d55 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:40.634821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:40.635876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 08:33:40.636695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:40.641855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 415/806] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:40 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:40.642909 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648683c-6f8c-42b5-83ba-eab7f40a7d55 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:40.702093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9d203-0ca5-4ae5-80b2-f83fffb7e874 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:40.740964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e8f72-3a73-4534-881f-ab9cec9faad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:40.742275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e8f72-3a73-4534-881f-ab9cec9faad1 None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:40.742815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e8f72-3a73-4534-881f-ab9cec9faad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:40.743288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e8f72-3a73-4534-881f-ab9cec9faad1 None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/7687888c51224d8e94018f35a82fbcc4/roles/72f436fe8f3041eea65efc9ea7545683` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:40.761082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e8f72-3a73-4534-881f-ab9cec9faad1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=7687888c51224d8e94018f35a82fbcc4, role_id=72f436fe8f3041eea65efc9ea7545683)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:40.763211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e8f72-3a73-4534-881f-ab9cec9faad1 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:40.777166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648683c-6f8c-42b5-83ba-eab7f40a7d55 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:40.807916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514c92d-bcf2-4ece-b543-8730c140301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:40.808579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514c92d-bcf2-4ece-b543-8730c140301a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:40.809440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514c92d-bcf2-4ece-b543-8730c140301a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:40.809440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514c92d-bcf2-4ece-b543-8730c140301a None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:40.810528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514c92d-bcf2-4ece-b543-8730c140301a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:40.810836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514c92d-bcf2-4ece-b543-8730c140301a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:40.812419 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514c92d-bcf2-4ece-b543-8730c140301a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:40.825385 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 416/807] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:40.826264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514c92d-bcf2-4ece-b543-8730c140301a None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:40.836419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 392/808] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:33:40 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/7687888c51224d8e94018f35a82fbcc4/roles/72f436fe8f3041eea65efc9ea7545683 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:33:40.838110 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e8f72-3a73-4534-881f-ab9cec9faad1 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:40.906776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:40.962919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:40.984454 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e8f72-3a73-4534-881f-ab9cec9faad1 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:41.017918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514c92d-bcf2-4ece-b543-8730c140301a None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:41.026172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f8bd1-c00e-478c-9135-9571fd0474e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:41.027437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f8bd1-c00e-478c-9135-9571fd0474e0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.027931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f8bd1-c00e-478c-9135-9571fd0474e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.028482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f8bd1-c00e-478c-9135-9571fd0474e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.037271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f8bd1-c00e-478c-9135-9571fd0474e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:41.039056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f8bd1-c00e-478c-9135-9571fd0474e0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-637f8bd1-c00e-478c-9135-9571fd0474e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:41.056188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:41.057178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:41.058107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:41.058107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:41.058107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:41.058107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:41.058107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:41.058107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:41.058107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:41.058107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:41.058107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:41.058107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:41.061399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 393/809] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:41.062098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c615f7-d6ea-4628-ad65-53b8fa169735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:41.063015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c615f7-d6ea-4628-ad65-53b8fa169735 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.064101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c615f7-d6ea-4628-ad65-53b8fa169735 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.064101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c615f7-d6ea-4628-ad65-53b8fa169735 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.064474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c615f7-d6ea-4628-ad65-53b8fa169735 None admin] RBAC: Adding query filter params (name=network) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:41.064870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c615f7-d6ea-4628-ad65-53b8fa169735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:41.066317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c615f7-d6ea-4628-ad65-53b8fa169735 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:41.066681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f8bd1-c00e-478c-9135-9571fd0474e0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:41.072759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 417/810] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:33:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:41.078755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c615f7-d6ea-4628-ad65-53b8fa169735 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:41.179825 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f8bd1-c00e-478c-9135-9571fd0474e0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:41.185485 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c615f7-d6ea-4628-ad65-53b8fa169735 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:41.197010 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:41.221101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd96ba0-d1fb-44c1-bedd-c7ec47d02e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:41.222184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd96ba0-d1fb-44c1-bedd-c7ec47d02e90 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.222707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd96ba0-d1fb-44c1-bedd-c7ec47d02e90 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.223120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93890c4c-1892-4f79-b53e-2addb63c9650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:41.223283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd96ba0-d1fb-44c1-bedd-c7ec47d02e90 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.224021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890c4c-1892-4f79-b53e-2addb63c9650 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.224401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890c4c-1892-4f79-b53e-2addb63c9650 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.224951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890c4c-1892-4f79-b53e-2addb63c9650 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.225171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd96ba0-d1fb-44c1-bedd-c7ec47d02e90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:41.225627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd96ba0-d1fb-44c1-bedd-c7ec47d02e90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:41.225736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93890c4c-1892-4f79-b53e-2addb63c9650 None admin] RBAC: Adding query filter params (type=network) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:41.226117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93890c4c-1892-4f79-b53e-2addb63c9650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:41.227488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd96ba0-d1fb-44c1-bedd-c7ec47d02e90 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:41.227785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93890c4c-1892-4f79-b53e-2addb63c9650 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:41.234390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 418/811] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:33:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:41.239700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93890c4c-1892-4f79-b53e-2addb63c9650 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:41.250299 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 394/812] 10.222.0.78 () {56 vars in 1135 bytes} [Fri Jun 17 08:33:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:41.260340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd96ba0-d1fb-44c1-bedd-c7ec47d02e90 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:41.264145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:41.407005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93890c4c-1892-4f79-b53e-2addb63c9650 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:41.434480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd96ba0-d1fb-44c1-bedd-c7ec47d02e90 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:41.444249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f96952-e5c7-4b46-9966-1b1d5b6627c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:41.444929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f96952-e5c7-4b46-9966-1b1d5b6627c7 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.445212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f96952-e5c7-4b46-9966-1b1d5b6627c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.445493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f96952-e5c7-4b46-9966-1b1d5b6627c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.446306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f96952-e5c7-4b46-9966-1b1d5b6627c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:41.450990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f96952-e5c7-4b46-9966-1b1d5b6627c7 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:41.486298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ee0d5-bfd0-4475-9de0-2a65b688cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:41.487572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee0d5-bfd0-4475-9de0-2a65b688cf15 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.488051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee0d5-bfd0-4475-9de0-2a65b688cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.488514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee0d5-bfd0-4475-9de0-2a65b688cf15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.501392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ee0d5-bfd0-4475-9de0-2a65b688cf15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:41.503279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ee0d5-bfd0-4475-9de0-2a65b688cf15 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-c33ee0d5-bfd0-4475-9de0-2a65b688cf15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:41.522452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:41.523441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:41.524341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:41.524341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:41.524341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:41.524341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:41.526658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 395/813] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:41.532541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ee0d5-bfd0-4475-9de0-2a65b688cf15 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:41.560790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 419/814] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Jun 17 08:33:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:41.600389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:41.658093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ee0d5-bfd0-4475-9de0-2a65b688cf15 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:41.704450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf08f37-9e0b-4641-b5b9-8b98ff21e647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:41.705132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf08f37-9e0b-4641-b5b9-8b98ff21e647 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.705465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf08f37-9e0b-4641-b5b9-8b98ff21e647 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf08f37-9e0b-4641-b5b9-8b98ff21e647 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.706553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf08f37-9e0b-4641-b5b9-8b98ff21e647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:41.706850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf08f37-9e0b-4641-b5b9-8b98ff21e647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:41.708397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf08f37-9e0b-4641-b5b9-8b98ff21e647 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:41.713542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a58e4-9b5f-49b5-b9cc-4d564fd52f39 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.714196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a58e4-9b5f-49b5-b9cc-4d564fd52f39 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.714676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a58e4-9b5f-49b5-b9cc-4d564fd52f39 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.721502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 420/815] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:41.727563 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 396/816] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:41.729112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf08f37-9e0b-4641-b5b9-8b98ff21e647 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:41.729516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f9c1-737e-4832-985c-a6d479e59ed0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.729804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f9c1-737e-4832-985c-a6d479e59ed0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.730083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f9c1-737e-4832-985c-a6d479e59ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.777030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1c14f9c1-737e-4832-985c-a6d479e59ed0 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:41.778276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1c14f9c1-737e-4832-985c-a6d479e59ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:41.827614 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:41.845827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf08f37-9e0b-4641-b5b9-8b98ff21e647 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:41.857368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:41.884513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 421/817] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:41.889004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc43c16-453e-4941-87bf-9e159da368a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:41.889004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43c16-453e-4941-87bf-9e159da368a6 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:41.889004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43c16-453e-4941-87bf-9e159da368a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:41.889004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43c16-453e-4941-87bf-9e159da368a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:41.894129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc43c16-453e-4941-87bf-9e159da368a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:41.896075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc43c16-453e-4941-87bf-9e159da368a6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-3fc43c16-453e-4941-87bf-9e159da368a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:41.915083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:41.916370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:41.917254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:41.917254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:41.917254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:41.917254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:41.917254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:41.917254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:41.917254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:41.917254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:41.917678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14f9c1-737e-4832-985c-a6d479e59ed0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:41.917752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 397/818] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:41.920461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc43c16-453e-4941-87bf-9e159da368a6 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:42.052971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14f9c1-737e-4832-985c-a6d479e59ed0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:42.073625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc43c16-453e-4941-87bf-9e159da368a6 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:42.094887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca656e-96e3-473a-8bf4-16f42b99c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:42.095725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca656e-96e3-473a-8bf4-16f42b99c718 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:42.096007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca656e-96e3-473a-8bf4-16f42b99c718 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:42.096285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca656e-96e3-473a-8bf4-16f42b99c718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:42.114233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca656e-96e3-473a-8bf4-16f42b99c718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:42.120357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74395-1f23-4b33-901d-850509390d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:42.120718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74395-1f23-4b33-901d-850509390d09 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:42.121096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74395-1f23-4b33-901d-850509390d09 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:42.121461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74395-1f23-4b33-901d-850509390d09 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:42.122376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74395-1f23-4b33-901d-850509390d09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:42.122779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74395-1f23-4b33-901d-850509390d09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-15ca656e-96e3-473a-8bf4-16f42b99c718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:42.123727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:42.124806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:42.125839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:42.127272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74395-1f23-4b33-901d-850509390d09 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:42.128462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 422/819] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:42.134633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca656e-96e3-473a-8bf4-16f42b99c718 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:42.145751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 398/820] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:42.151612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74395-1f23-4b33-901d-850509390d09 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:42.162105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:42.185156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:42.267180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca656e-96e3-473a-8bf4-16f42b99c718 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:42.281011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74395-1f23-4b33-901d-850509390d09 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:42.315374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ad3b-460f-423c-8d8c-0754ec845e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:42.315374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ad3b-460f-423c-8d8c-0754ec845e11 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:42.315374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ad3b-460f-423c-8d8c-0754ec845e11 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:42.315374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ad3b-460f-423c-8d8c-0754ec845e11 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:42.315788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578ad3b-460f-423c-8d8c-0754ec845e11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:42.315788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578ad3b-460f-423c-8d8c-0754ec845e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:42.317369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578ad3b-460f-423c-8d8c-0754ec845e11 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:42.320952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1f283-0fa0-4a36-b66b-73f7c140795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:42.321851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1f283-0fa0-4a36-b66b-73f7c140795a None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:42.322134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1f283-0fa0-4a36-b66b-73f7c140795a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:42.322414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1f283-0fa0-4a36-b66b-73f7c140795a None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/46e2b769ba9b46778c96b2a04d45612d/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:42.324414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1f283-0fa0-4a36-b66b-73f7c140795a None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=46e2b769ba9b46778c96b2a04d45612d, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:42.326241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1f283-0fa0-4a36-b66b-73f7c140795a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:42.327182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 423/821] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:42.332701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ad3b-460f-423c-8d8c-0754ec845e11 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:42.410029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 399/822] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:33:42 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/46e2b769ba9b46778c96b2a04d45612d/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:33:42.433117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:42.456398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ad3b-460f-423c-8d8c-0754ec845e11 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:42.501668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086230d5-3e21-4c49-8895-60635f7cc301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:42.502550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086230d5-3e21-4c49-8895-60635f7cc301 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:42.502897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086230d5-3e21-4c49-8895-60635f7cc301 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:42.503271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086230d5-3e21-4c49-8895-60635f7cc301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:42.517556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086230d5-3e21-4c49-8895-60635f7cc301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:42.519229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086230d5-3e21-4c49-8895-60635f7cc301 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-086230d5-3e21-4c49-8895-60635f7cc301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:42.541114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:42.542065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:42.542949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:42.542949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:42.542949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:42.542949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:42.542949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 424/823] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:42.549414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1f283-0fa0-4a36-b66b-73f7c140795a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:42.657317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:42.667266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1f283-0fa0-4a36-b66b-73f7c140795a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:42.704349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd3f50-e79d-4773-a380-71ab862927d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:42.704943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd3f50-e79d-4773-a380-71ab862927d2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:42.705227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd3f50-e79d-4773-a380-71ab862927d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:42.705507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd3f50-e79d-4773-a380-71ab862927d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:42.706372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd3f50-e79d-4773-a380-71ab862927d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:42.706681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd3f50-e79d-4773-a380-71ab862927d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:42.708133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd3f50-e79d-4773-a380-71ab862927d2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:42.721558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 400/824] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:42.727035 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086230d5-3e21-4c49-8895-60635f7cc301 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:42.834211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f41f-bdf0-49e8-bc5e-7f8d6f22ebf5 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:42.834540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f41f-bdf0-49e8-bc5e-7f8d6f22ebf5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:42.835137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682f41f-bdf0-49e8-bc5e-7f8d6f22ebf5 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:42.837085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 401/825] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:42.843051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75782b-aef1-44a3-8800-560a3f9d4c26 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:42.843687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75782b-aef1-44a3-8800-560a3f9d4c26 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:42.844230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75782b-aef1-44a3-8800-560a3f9d4c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:42.846051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086230d5-3e21-4c49-8895-60635f7cc301 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:42.865810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2c75782b-aef1-44a3-8800-560a3f9d4c26 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:42.867018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2c75782b-aef1-44a3-8800-560a3f9d4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:42.882468 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051f071-698c-430f-a715-bb9755ce5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:42.883269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f071-698c-430f-a715-bb9755ce5065 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:42.883584 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f071-698c-430f-a715-bb9755ce5065 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:42.883904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051f071-698c-430f-a715-bb9755ce5065 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:42.885858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:42.892988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051f071-698c-430f-a715-bb9755ce5065 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:42.894676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051f071-698c-430f-a715-bb9755ce5065 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-6051f071-698c-430f-a715-bb9755ce5065 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:42.910731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:42.911978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:42.913195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:42.913195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:42.913195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:42.913195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:42.913195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:42.913195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:42.913195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:42.913195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:42.913195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:33:42.913195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:42.915473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 425/826] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Jun 17 08:33:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:42.923337 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051f071-698c-430f-a715-bb9755ce5065 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:42.962396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 402/827] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:42.984577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75782b-aef1-44a3-8800-560a3f9d4c26 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:43.038637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051f071-698c-430f-a715-bb9755ce5065 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:43.073997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:43.076326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed808dc-428a-4947-8309-40d01bf58533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:43.077043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed808dc-428a-4947-8309-40d01bf58533 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:43.077331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed808dc-428a-4947-8309-40d01bf58533 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:43.077947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed808dc-428a-4947-8309-40d01bf58533 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:43.078467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed808dc-428a-4947-8309-40d01bf58533 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:43.078847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed808dc-428a-4947-8309-40d01bf58533 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:43.080403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed808dc-428a-4947-8309-40d01bf58533 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:43.098725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75782b-aef1-44a3-8800-560a3f9d4c26 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:43.104916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 426/828] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Jun 17 08:33:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:43.106686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed808dc-428a-4947-8309-40d01bf58533 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:43.142893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c38b72-fa41-4c3d-ab12-487ae1207edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:43.144107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c38b72-fa41-4c3d-ab12-487ae1207edc None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:43.144613 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c38b72-fa41-4c3d-ab12-487ae1207edc None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:43.145127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c38b72-fa41-4c3d-ab12-487ae1207edc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:43.146005 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c38b72-fa41-4c3d-ab12-487ae1207edc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:43.147624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c38b72-fa41-4c3d-ab12-487ae1207edc None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:43.164696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-54c38b72-fa41-4c3d-ab12-487ae1207edc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:43.164893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:43.165844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:33:43.166663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:43.169927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 403/829] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:33:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:43.179279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c38b72-fa41-4c3d-ab12-487ae1207edc None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:43.219199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed808dc-428a-4947-8309-40d01bf58533 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:43.260412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673148a8-ce32-432a-b69f-6fcf050d923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:43.261075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673148a8-ce32-432a-b69f-6fcf050d923f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:43.261358 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673148a8-ce32-432a-b69f-6fcf050d923f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:43.261635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673148a8-ce32-432a-b69f-6fcf050d923f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:43.302871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c38b72-fa41-4c3d-ab12-487ae1207edc None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:43.344647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679152-15d2-4aa1-80ba-b7bee1abb118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:43.345431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679152-15d2-4aa1-80ba-b7bee1abb118 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:43.345783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679152-15d2-4aa1-80ba-b7bee1abb118 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:43.346125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac679152-15d2-4aa1-80ba-b7bee1abb118 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:43.347001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac679152-15d2-4aa1-80ba-b7bee1abb118 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:43.347833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac679152-15d2-4aa1-80ba-b7bee1abb118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:43.349519 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac679152-15d2-4aa1-80ba-b7bee1abb118 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:43.349739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673148a8-ce32-432a-b69f-6fcf050d923f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:43.351187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673148a8-ce32-432a-b69f-6fcf050d923f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:43.361263 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 404/830] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:33:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:43.362990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679152-15d2-4aa1-80ba-b7bee1abb118 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:43.378203 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:43.408090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:43.460122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 427/831] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 08:33:43.461499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbc47a-51b5-43b5-b07b-38252a60c1d3 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:43.461793 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbc47a-51b5-43b5-b07b-38252a60c1d3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:43.462075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbc47a-51b5-43b5-b07b-38252a60c1d3 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:43.463558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 428/832] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:43.469109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbc47a-51b5-43b5-b07b-38252a60c1d3 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:43.492374 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac679152-15d2-4aa1-80ba-b7bee1abb118 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:43.533796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130ee18-7511-4dd1-bb1a-0eb4db5ab052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:43.534472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130ee18-7511-4dd1-bb1a-0eb4db5ab052 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:43.534762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130ee18-7511-4dd1-bb1a-0eb4db5ab052 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:43.535043 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130ee18-7511-4dd1-bb1a-0eb4db5ab052 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:43.535787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130ee18-7511-4dd1-bb1a-0eb4db5ab052 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:43.536303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130ee18-7511-4dd1-bb1a-0eb4db5ab052 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:43.537463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130ee18-7511-4dd1-bb1a-0eb4db5ab052 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:43.551717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 405/833] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:33:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:43.553124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04bdfb-fe9b-4d9f-80d9-cd31c5bb5b5d None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:43.553452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04bdfb-fe9b-4d9f-80d9-cd31c5bb5b5d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:43.553732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04bdfb-fe9b-4d9f-80d9-cd31c5bb5b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:43.583095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2a04bdfb-fe9b-4d9f-80d9-cd31c5bb5b5d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:43.585595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2a04bdfb-fe9b-4d9f-80d9-cd31c5bb5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:43.599134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbc47a-51b5-43b5-b07b-38252a60c1d3 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:43.648592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ebc1d-944a-4feb-a2c2-4e9dc519a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:43.650082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ebc1d-944a-4feb-a2c2-4e9dc519a411 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:43.650367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ebc1d-944a-4feb-a2c2-4e9dc519a411 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:43.650646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ebc1d-944a-4feb-a2c2-4e9dc519a411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:43.664877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ebc1d-944a-4feb-a2c2-4e9dc519a411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:43.666338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ebc1d-944a-4feb-a2c2-4e9dc519a411 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-b76ebc1d-944a-4feb-a2c2-4e9dc519a411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:43.687199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:43.688186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:43.689095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:43.689095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:43.689095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:43.689095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:43.693213 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 429/834] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:43.694183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ebc1d-944a-4feb-a2c2-4e9dc519a411 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:43.694654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 406/835] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:43.698197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:43.720834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04bdfb-fe9b-4d9f-80d9-cd31c5bb5b5d None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:43.723503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:43.831185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ebc1d-944a-4feb-a2c2-4e9dc519a411 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:43.849248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04bdfb-fe9b-4d9f-80d9-cd31c5bb5b5d None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:43.869729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a7eee-7845-42a6-b235-909a3c4eab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:43.870551 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a7eee-7845-42a6-b235-909a3c4eab15 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:43.871052 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a7eee-7845-42a6-b235-909a3c4eab15 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:43.871463 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a7eee-7845-42a6-b235-909a3c4eab15 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:43.872582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a7eee-7845-42a6-b235-909a3c4eab15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:43.873246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a7eee-7845-42a6-b235-909a3c4eab15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:43.874736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a7eee-7845-42a6-b235-909a3c4eab15 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:43.889135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 430/836] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:43.893464 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010fcda-ada7-406a-aa2e-9d75c4ea7f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:43.894016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a7eee-7845-42a6-b235-909a3c4eab15 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:43.894642 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010fcda-ada7-406a-aa2e-9d75c4ea7f3a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:43.895088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010fcda-ada7-406a-aa2e-9d75c4ea7f3a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:43.895538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010fcda-ada7-406a-aa2e-9d75c4ea7f3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:43.911273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010fcda-ada7-406a-aa2e-9d75c4ea7f3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-7010fcda-ada7-406a-aa2e-9d75c4ea7f3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:43.924388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:43.925536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:33:43.926582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:43.929931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 407/837] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:33:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:43.936413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010fcda-ada7-406a-aa2e-9d75c4ea7f3a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:43.972410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:44.018806 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:44.023119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a7eee-7845-42a6-b235-909a3c4eab15 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:44.063112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010fcda-ada7-406a-aa2e-9d75c4ea7f3a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:44.069775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9004-7549-4be5-82db-d3ea7f01e658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:44.070797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9004-7549-4be5-82db-d3ea7f01e658 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:44.071261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9004-7549-4be5-82db-d3ea7f01e658 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:44.072273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c9004-7549-4be5-82db-d3ea7f01e658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:44.083451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c9004-7549-4be5-82db-d3ea7f01e658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:44.085533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c9004-7549-4be5-82db-d3ea7f01e658 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:44.102382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f9425-263b-41a3-bf8f-4c06fbfb0c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:44.103147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f9425-263b-41a3-bf8f-4c06fbfb0c4d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:44.103523 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f9425-263b-41a3-bf8f-4c06fbfb0c4d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:44.103876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f9425-263b-41a3-bf8f-4c06fbfb0c4d None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:44.104713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f9425-263b-41a3-bf8f-4c06fbfb0c4d None admin] RBAC: Adding query filter params (name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:44.105092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f9425-263b-41a3-bf8f-4c06fbfb0c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-e35c9004-7549-4be5-82db-d3ea7f01e658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:44.105734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:44.106589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:44.107693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:44.107693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:44.107693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:44.107693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:44.107693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:44.107693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:44.107693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:44.107693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:44.108126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f9425-263b-41a3-bf8f-4c06fbfb0c4d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:44.110890 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 431/838] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:44.118738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9004-7549-4be5-82db-d3ea7f01e658 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:44.123524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 408/839] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:33:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:44.125914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f9425-263b-41a3-bf8f-4c06fbfb0c4d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:44.244475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c9004-7549-4be5-82db-d3ea7f01e658 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:44.244705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f9425-263b-41a3-bf8f-4c06fbfb0c4d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:44.271528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:44.273207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:44.285327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96ec72-8965-47af-ac78-2d42376c8ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:44.285893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adddec-2e53-403e-bacb-ce70e0de4145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:44.286452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ec72-8965-47af-ac78-2d42376c8ac1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:44.290146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adddec-2e53-403e-bacb-ce70e0de4145 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:44.290265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ec72-8965-47af-ac78-2d42376c8ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:44.290345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adddec-2e53-403e-bacb-ce70e0de4145 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:44.290422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ec72-8965-47af-ac78-2d42376c8ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:44.290500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adddec-2e53-403e-bacb-ce70e0de4145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:44.290572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96ec72-8965-47af-ac78-2d42376c8ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:44.290572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96ec72-8965-47af-ac78-2d42376c8ac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:44.291042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96ec72-8965-47af-ac78-2d42376c8ac1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:44.299072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adddec-2e53-403e-bacb-ce70e0de4145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:44.301141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53adddec-2e53-403e-bacb-ce70e0de4145 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:44.311543 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 432/840] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:44.313855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96ec72-8965-47af-ac78-2d42376c8ac1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-53adddec-2e53-403e-bacb-ce70e0de4145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:44.325871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:44.327127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:44.328371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:44.328371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:44.328371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:44.328371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:44.328371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 409/841] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:44.332665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adddec-2e53-403e-bacb-ce70e0de4145 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:44.464993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adddec-2e53-403e-bacb-ce70e0de4145 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:44.468375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96ec72-8965-47af-ac78-2d42376c8ac1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:44.511112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bcb18-dfad-496e-a317-41fd8097a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:44.511828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bcb18-dfad-496e-a317-41fd8097a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:44.512086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bcb18-dfad-496e-a317-41fd8097a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:44.512368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bcb18-dfad-496e-a317-41fd8097a7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:44.513712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bcb18-dfad-496e-a317-41fd8097a7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:44.514040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bcb18-dfad-496e-a317-41fd8097a7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:44.515539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bcb18-dfad-496e-a317-41fd8097a7f3 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:44.516659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319f93-2750-4971-802e-00e16d831c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:44.517548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319f93-2750-4971-802e-00e16d831c03 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:44.518054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319f93-2750-4971-802e-00e16d831c03 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:44.518527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319f93-2750-4971-802e-00e16d831c03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:44.519585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319f93-2750-4971-802e-00e16d831c03 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=6aa3618089794b938018ff2666afebe3) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:44.520124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319f93-2750-4971-802e-00e16d831c03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:44.521743 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319f93-2750-4971-802e-00e16d831c03 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:44.529932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 433/842] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:44 2022] GET /identity/v3/role_assignments?user.id=6aa3618089794b938018ff2666afebe3&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:44.534473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 410/843] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:44.536477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bcb18-dfad-496e-a317-41fd8097a7f3 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:44.582594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:44.663844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bcb18-dfad-496e-a317-41fd8097a7f3 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:44.706363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774cd6a-578c-43e4-9087-d08c51341423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:44.707558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774cd6a-578c-43e4-9087-d08c51341423 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:44.708050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774cd6a-578c-43e4-9087-d08c51341423 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:44.708545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774cd6a-578c-43e4-9087-d08c51341423 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:44.717644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774cd6a-578c-43e4-9087-d08c51341423 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:44.719407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774cd6a-578c-43e4-9087-d08c51341423 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:44.723627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6186-6c89-4186-91db-08b2bb5a5bd7 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:44.723978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6186-6c89-4186-91db-08b2bb5a5bd7 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:44.724190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6186-6c89-4186-91db-08b2bb5a5bd7 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:44.725922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 434/844] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:44.732259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9371-720b-44d0-9c6f-972a94051bd5 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:44.732619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9371-720b-44d0-9c6f-972a94051bd5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:44.732904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad9371-720b-44d0-9c6f-972a94051bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-c774cd6a-578c-43e4-9087-d08c51341423 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:44.739456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:44.740658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:44.741623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:44.741623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:44.741623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:44.741623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:44.741623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:44.741623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:44.741623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:44.741623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:44.741623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:44.741623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:44.743942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 411/845] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Jun 17 08:33:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:44.750642 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774cd6a-578c-43e4-9087-d08c51341423 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:44.753258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-33ad9371-720b-44d0-9c6f-972a94051bd5 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:44.754624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-33ad9371-720b-44d0-9c6f-972a94051bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:44.821037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:44.847798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 435/846] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:44.861866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:44.868046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774cd6a-578c-43e4-9087-d08c51341423 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:44.874746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad9371-720b-44d0-9c6f-972a94051bd5 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:44.907703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076874c2-b9a9-4bd2-afa8-046b13a3e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:44.909325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076874c2-b9a9-4bd2-afa8-046b13a3e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:44.909759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076874c2-b9a9-4bd2-afa8-046b13a3e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:44.910183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076874c2-b9a9-4bd2-afa8-046b13a3e6c5 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:44.911168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076874c2-b9a9-4bd2-afa8-046b13a3e6c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:44.911843 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076874c2-b9a9-4bd2-afa8-046b13a3e6c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:44.914214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076874c2-b9a9-4bd2-afa8-046b13a3e6c5 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:44.941330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 412/847] 10.222.0.78 () {56 vars in 1149 bytes} [Fri Jun 17 08:33:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:44.942351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076874c2-b9a9-4bd2-afa8-046b13a3e6c5 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:45.001063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad9371-720b-44d0-9c6f-972a94051bd5 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.049907 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f1411-bd7e-4bc0-ab06-48c5274444f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:45.050962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f1411-bd7e-4bc0-ab06-48c5274444f8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.051417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f1411-bd7e-4bc0-ab06-48c5274444f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.051841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f1411-bd7e-4bc0-ab06-48c5274444f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.052170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076874c2-b9a9-4bd2-afa8-046b13a3e6c5 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.066286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f1411-bd7e-4bc0-ab06-48c5274444f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-3a2f1411-bd7e-4bc0-ab06-48c5274444f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:45.077843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:45.078846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:33:45.079731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:45.080982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 436/848] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:45.086701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f1411-bd7e-4bc0-ab06-48c5274444f8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:45.099381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d85db1-a0f2-4557-aa94-7d4a25130214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:45.100061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d85db1-a0f2-4557-aa94-7d4a25130214 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.100717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d85db1-a0f2-4557-aa94-7d4a25130214 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.101002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d85db1-a0f2-4557-aa94-7d4a25130214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.130100 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:45.133597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:45.196170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f1411-bd7e-4bc0-ab06-48c5274444f8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.197553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d85db1-a0f2-4557-aa94-7d4a25130214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:45.200827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d85db1-a0f2-4557-aa94-7d4a25130214 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:45.236329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be911b5-a027-41c8-8d83-ad410f5c770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:45.237271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be911b5-a027-41c8-8d83-ad410f5c770e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.237718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be911b5-a027-41c8-8d83-ad410f5c770e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.238143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be911b5-a027-41c8-8d83-ad410f5c770e None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.239206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be911b5-a027-41c8-8d83-ad410f5c770e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:45.239765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be911b5-a027-41c8-8d83-ad410f5c770e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:45.241352 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be911b5-a027-41c8-8d83-ad410f5c770e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:45.259472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 437/849] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:45.261565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be911b5-a027-41c8-8d83-ad410f5c770e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:45.333847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 413/850] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 08:33:45.339189 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d85db1-a0f2-4557-aa94-7d4a25130214 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:45.381598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:45.386564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be911b5-a027-41c8-8d83-ad410f5c770e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.399293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:45.428295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5885011-7a3a-4289-b1b2-50c9f7e67735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:45.429996 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5885011-7a3a-4289-b1b2-50c9f7e67735 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.430532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5885011-7a3a-4289-b1b2-50c9f7e67735 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.430978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5885011-7a3a-4289-b1b2-50c9f7e67735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.445022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5885011-7a3a-4289-b1b2-50c9f7e67735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:45.447287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5885011-7a3a-4289-b1b2-50c9f7e67735 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:45.448852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d85db1-a0f2-4557-aa94-7d4a25130214 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-e5885011-7a3a-4289-b1b2-50c9f7e67735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:45.473050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:45.474250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:45.475143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:45.475143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:45.475143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:45.475143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:45.480333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 438/851] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:45.481276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5885011-7a3a-4289-b1b2-50c9f7e67735 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:45.497502 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ea065-0290-4ba3-b47b-10a8211424ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:45.499075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea065-0290-4ba3-b47b-10a8211424ba None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.499820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea065-0290-4ba3-b47b-10a8211424ba None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.500278 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea065-0290-4ba3-b47b-10a8211424ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.517133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ea065-0290-4ba3-b47b-10a8211424ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:45.518835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ea065-0290-4ba3-b47b-10a8211424ba None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-a84ea065-0290-4ba3-b47b-10a8211424ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:45.542434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:45.543371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:45.544316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:45.544316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:45.544316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:45.544316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:45.549820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 414/852] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:45.550463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ea065-0290-4ba3-b47b-10a8211424ba None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:45.598854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5885011-7a3a-4289-b1b2-50c9f7e67735 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.637067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f9988-630d-468c-ab1a-db45ba0cd15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:45.638329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9988-630d-468c-ab1a-db45ba0cd15e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.638825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9988-630d-468c-ab1a-db45ba0cd15e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.639241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9988-630d-468c-ab1a-db45ba0cd15e None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.640030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f9988-630d-468c-ab1a-db45ba0cd15e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:45.640340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f9988-630d-468c-ab1a-db45ba0cd15e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:45.641858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f9988-630d-468c-ab1a-db45ba0cd15e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:45.658810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 439/853] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:45.659752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f9988-630d-468c-ab1a-db45ba0cd15e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:45.675973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:45.690421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ea065-0290-4ba3-b47b-10a8211424ba None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.702375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:45.740181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950338a-1df3-44a6-8ed6-ff8e15507ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:45.741443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950338a-1df3-44a6-8ed6-ff8e15507ca3 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.741966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950338a-1df3-44a6-8ed6-ff8e15507ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.742536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950338a-1df3-44a6-8ed6-ff8e15507ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.743877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950338a-1df3-44a6-8ed6-ff8e15507ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:45.744366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950338a-1df3-44a6-8ed6-ff8e15507ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:45.746219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950338a-1df3-44a6-8ed6-ff8e15507ca3 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:45.767559 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 415/854] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:45.770767 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950338a-1df3-44a6-8ed6-ff8e15507ca3 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:45.799619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f9988-630d-468c-ab1a-db45ba0cd15e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.836866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fa7b7-102b-4fe2-bd1e-9f59cdc45ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:45.837726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa7b7-102b-4fe2-bd1e-9f59cdc45ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.838016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa7b7-102b-4fe2-bd1e-9f59cdc45ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.838344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa7b7-102b-4fe2-bd1e-9f59cdc45ae5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.846132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fa7b7-102b-4fe2-bd1e-9f59cdc45ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:45.847664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fa7b7-102b-4fe2-bd1e-9f59cdc45ae5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-3e9fa7b7-102b-4fe2-bd1e-9f59cdc45ae5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:45.862667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:45.863758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:45.864810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 440/855] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:33:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:45.865444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ad61b-f8f7-4999-8d76-94eb3899543e None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.865519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ad61b-f8f7-4999-8d76-94eb3899543e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.866244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ad61b-f8f7-4999-8d76-94eb3899543e None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.871127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 441/856] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:45.871127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ad61b-f8f7-4999-8d76-94eb3899543e None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:45.889004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950338a-1df3-44a6-8ed6-ff8e15507ca3 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.925673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf397cee-176c-4d69-98b0-f39f7cd2e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:45.926492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397cee-176c-4d69-98b0-f39f7cd2e745 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.926788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397cee-176c-4d69-98b0-f39f7cd2e745 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.927050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397cee-176c-4d69-98b0-f39f7cd2e745 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.935257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397cee-176c-4d69-98b0-f39f7cd2e745 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:45.936828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397cee-176c-4d69-98b0-f39f7cd2e745 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:45.942428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-cf397cee-176c-4d69-98b0-f39f7cd2e745 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:45.953402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:45.960076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 416/857] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed962f14-bce7-4d49-8f9a-80ad6621f701 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:45.960982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed962f14-bce7-4d49-8f9a-80ad6621f701 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:45.961621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed962f14-bce7-4d49-8f9a-80ad6621f701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:45.977204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ad61b-f8f7-4999-8d76-94eb3899543e None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:45.978137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ed962f14-bce7-4d49-8f9a-80ad6621f701 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:45.979596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ed962f14-bce7-4d49-8f9a-80ad6621f701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:46.002365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:46.016297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d7ea9-5d6d-46cd-83e3-0289ccd706d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:46.016971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7ea9-5d6d-46cd-83e3-0289ccd706d8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.017423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7ea9-5d6d-46cd-83e3-0289ccd706d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.017759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7ea9-5d6d-46cd-83e3-0289ccd706d8 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.019323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d7ea9-5d6d-46cd-83e3-0289ccd706d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:46.019671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d7ea9-5d6d-46cd-83e3-0289ccd706d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:46.021169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d7ea9-5d6d-46cd-83e3-0289ccd706d8 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:46.040124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 442/858] 10.222.0.78 () {56 vars in 1135 bytes} [Fri Jun 17 08:33:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:46.040951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d7ea9-5d6d-46cd-83e3-0289ccd706d8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:46.059007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 417/859] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:46.060587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed962f14-bce7-4d49-8f9a-80ad6621f701 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:46.148332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d7ea9-5d6d-46cd-83e3-0289ccd706d8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:46.180787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:46.188299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910de88d-9a78-43a8-b2e7-675b5df36647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:46.188784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed962f14-bce7-4d49-8f9a-80ad6621f701 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:46.189227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910de88d-9a78-43a8-b2e7-675b5df36647 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.189729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910de88d-9a78-43a8-b2e7-675b5df36647 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.190214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910de88d-9a78-43a8-b2e7-675b5df36647 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.191453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910de88d-9a78-43a8-b2e7-675b5df36647 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:46.198539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910de88d-9a78-43a8-b2e7-675b5df36647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:46.198539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910de88d-9a78-43a8-b2e7-675b5df36647 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:46.208626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 443/860] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:46.209923 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910de88d-9a78-43a8-b2e7-675b5df36647 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:46.232931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da6f30-5fe5-4a0d-a801-d4de6b94f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:46.233586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da6f30-5fe5-4a0d-a801-d4de6b94f69b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.233871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da6f30-5fe5-4a0d-a801-d4de6b94f69b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.234150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da6f30-5fe5-4a0d-a801-d4de6b94f69b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.261934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:46.313259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da6f30-5fe5-4a0d-a801-d4de6b94f69b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:46.314715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da6f30-5fe5-4a0d-a801-d4de6b94f69b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:46.332380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910de88d-9a78-43a8-b2e7-675b5df36647 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:46.370686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f085a-b7b8-441d-b049-faf9d85d287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:46.371385 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f085a-b7b8-441d-b049-faf9d85d287f None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.371673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f085a-b7b8-441d-b049-faf9d85d287f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.371951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f085a-b7b8-441d-b049-faf9d85d287f None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.373061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f085a-b7b8-441d-b049-faf9d85d287f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:46.374458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f085a-b7b8-441d-b049-faf9d85d287f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:46.426651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 418/861] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:33:46.427614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da6f30-5fe5-4a0d-a801-d4de6b94f69b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:46.470024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 444/862] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:33:46 2022] POST /identity/v3/services => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:46.478473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f085a-b7b8-441d-b049-faf9d85d287f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:46.516470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:46.537082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:46.588385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da6f30-5fe5-4a0d-a801-d4de6b94f69b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:46.608589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f085a-b7b8-441d-b049-faf9d85d287f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:46.639799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0d104-2ee3-4f3f-ae85-5bbad3e34603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:46.641382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0d104-2ee3-4f3f-ae85-5bbad3e34603 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.641820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0d104-2ee3-4f3f-ae85-5bbad3e34603 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.642248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0d104-2ee3-4f3f-ae85-5bbad3e34603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.643899 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0d104-2ee3-4f3f-ae85-5bbad3e34603 None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=7687888c51224d8e94018f35a82fbcc4) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:46.644774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0d104-2ee3-4f3f-ae85-5bbad3e34603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:46.646786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0d104-2ee3-4f3f-ae85-5bbad3e34603 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:46.648613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffb836-0c39-4fee-8ee3-c74a3fee0877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:46.649438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffb836-0c39-4fee-8ee3-c74a3fee0877 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.649718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffb836-0c39-4fee-8ee3-c74a3fee0877 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.649999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffb836-0c39-4fee-8ee3-c74a3fee0877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.658323 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 419/863] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:46 2022] GET /identity/v3/role_assignments?user.id=7687888c51224d8e94018f35a82fbcc4&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:46.670322 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffb836-0c39-4fee-8ee3-c74a3fee0877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:46.672178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffb836-0c39-4fee-8ee3-c74a3fee0877 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-2cffb836-0c39-4fee-8ee3-c74a3fee0877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:46.695897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:46.696885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:46.697776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:46.697776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:46.697776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:46.697776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:46.701507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 445/864] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:46.704182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0d104-2ee3-4f3f-ae85-5bbad3e34603 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:46.846531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0d104-2ee3-4f3f-ae85-5bbad3e34603 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:46.875658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:46.875851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae333-86e4-4f14-97c9-6fefc376ee77 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.876478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae333-86e4-4f14-97c9-6fefc376ee77 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.876478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae333-86e4-4f14-97c9-6fefc376ee77 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.878639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 446/865] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:46.886782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108edd0c-7db5-473d-9c59-663ac50b2cc8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.891234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108edd0c-7db5-473d-9c59-663ac50b2cc8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.891234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108edd0c-7db5-473d-9c59-663ac50b2cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.893206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988b55a-6b56-4701-8922-2a363a1c9535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:46.893886 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988b55a-6b56-4701-8922-2a363a1c9535 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:46.894184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988b55a-6b56-4701-8922-2a363a1c9535 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:46.894456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988b55a-6b56-4701-8922-2a363a1c9535 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:46.895217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988b55a-6b56-4701-8922-2a363a1c9535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:46.895678 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988b55a-6b56-4701-8922-2a363a1c9535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:46.897085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988b55a-6b56-4701-8922-2a363a1c9535 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:46.909147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-108edd0c-7db5-473d-9c59-663ac50b2cc8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:46.911174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-108edd0c-7db5-473d-9c59-663ac50b2cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:46.917239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 420/866] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:46.918505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988b55a-6b56-4701-8922-2a363a1c9535 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:47.021027 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 447/867] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:47.047055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108edd0c-7db5-473d-9c59-663ac50b2cc8 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:47.062394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988b55a-6b56-4701-8922-2a363a1c9535 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:47.082685 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:47.116214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f849f-ac09-492b-ae06-614a63eaa03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:47.117363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f849f-ac09-492b-ae06-614a63eaa03b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:47.117952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f849f-ac09-492b-ae06-614a63eaa03b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:47.118712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f849f-ac09-492b-ae06-614a63eaa03b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:47.128568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f849f-ac09-492b-ae06-614a63eaa03b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:47.131945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f849f-ac09-492b-ae06-614a63eaa03b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-9a0f849f-ac09-492b-ae06-614a63eaa03b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:47.156955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:47.158266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:47.159638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:47.159638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:47.159638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:47.159638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:47.159638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:47.159638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:47.159638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:47.159638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:47.166307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 421/868] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:47.167914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f849f-ac09-492b-ae06-614a63eaa03b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:47.177266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108edd0c-7db5-473d-9c59-663ac50b2cc8 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:47.223639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:47.225261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dbf07-603b-4855-b400-a2ab7d50cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:47.226894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dbf07-603b-4855-b400-a2ab7d50cc40 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:47.227329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dbf07-603b-4855-b400-a2ab7d50cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:47.227804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dbf07-603b-4855-b400-a2ab7d50cc40 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:47.228772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dbf07-603b-4855-b400-a2ab7d50cc40 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:47.230960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dbf07-603b-4855-b400-a2ab7d50cc40 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-a52dbf07-603b-4855-b400-a2ab7d50cc40 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:47.245887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:47.246926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:33:47.247869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:47.251652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 448/869] 10.222.0.78 () {56 vars in 1132 bytes} [Fri Jun 17 08:33:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:47.253347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dbf07-603b-4855-b400-a2ab7d50cc40 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:47.305073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f849f-ac09-492b-ae06-614a63eaa03b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:47.350579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f24744-a84c-40f9-af90-535d7e4f3e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:47.351254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:47.352012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f24744-a84c-40f9-af90-535d7e4f3e5b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:47.352012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f24744-a84c-40f9-af90-535d7e4f3e5b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:47.352738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f24744-a84c-40f9-af90-535d7e4f3e5b None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:47.354432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f24744-a84c-40f9-af90-535d7e4f3e5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:47.354432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f24744-a84c-40f9-af90-535d7e4f3e5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:47.355566 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f24744-a84c-40f9-af90-535d7e4f3e5b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:47.367666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dbf07-603b-4855-b400-a2ab7d50cc40 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:47.369633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 422/870] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:47.379467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f24744-a84c-40f9-af90-535d7e4f3e5b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:47.410453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c4c62-34c3-43d0-b174-7eb3286e0c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:47.411815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c4c62-34c3-43d0-b174-7eb3286e0c2f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:47.412255 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c4c62-34c3-43d0-b174-7eb3286e0c2f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:47.413124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c4c62-34c3-43d0-b174-7eb3286e0c2f None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:47.414339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c4c62-34c3-43d0-b174-7eb3286e0c2f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:47.414820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c4c62-34c3-43d0-b174-7eb3286e0c2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:47.417252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c4c62-34c3-43d0-b174-7eb3286e0c2f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:47.424911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 449/871] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:33:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:47.430511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c4c62-34c3-43d0-b174-7eb3286e0c2f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:47.508522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:47.513565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f24744-a84c-40f9-af90-535d7e4f3e5b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:47.558850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c4c62-34c3-43d0-b174-7eb3286e0c2f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:47.560235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b68b36-86aa-4507-bc26-2692225f364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:47.561055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68b36-86aa-4507-bc26-2692225f364b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:47.561425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68b36-86aa-4507-bc26-2692225f364b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:47.562068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68b36-86aa-4507-bc26-2692225f364b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:47.563607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b68b36-86aa-4507-bc26-2692225f364b None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=46e2b769ba9b46778c96b2a04d45612d) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:47.564148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b68b36-86aa-4507-bc26-2692225f364b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:47.565583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b68b36-86aa-4507-bc26-2692225f364b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:47.579888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 423/872] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:47 2022] GET /identity/v3/role_assignments?user.id=46e2b769ba9b46778c96b2a04d45612d&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:47.611799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495144e-286f-4532-a4c1-8984e3c4ffc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:47.612490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495144e-286f-4532-a4c1-8984e3c4ffc5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:47.612777 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495144e-286f-4532-a4c1-8984e3c4ffc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:47.613053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495144e-286f-4532-a4c1-8984e3c4ffc5 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:47.613774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495144e-286f-4532-a4c1-8984e3c4ffc5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:47.614111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495144e-286f-4532-a4c1-8984e3c4ffc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:47.615579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495144e-286f-4532-a4c1-8984e3c4ffc5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:47.621198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 450/873] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:33:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:48.793852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf6cbd-baf7-4ff5-aed6-5bf575793ca0 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:48.794404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf6cbd-baf7-4ff5-aed6-5bf575793ca0 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:48.794670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf6cbd-baf7-4ff5-aed6-5bf575793ca0 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:48.796093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 424/874] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:48.801534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769358b-3d5a-4cff-86d1-67763da7e9a9 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:48.802370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769358b-3d5a-4cff-86d1-67763da7e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:48.802953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769358b-3d5a-4cff-86d1-67763da7e9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:48.822414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-6769358b-3d5a-4cff-86d1-67763da7e9a9 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:48.824041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6769358b-3d5a-4cff-86d1-67763da7e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:48.842556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:48.905160 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 451/875] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:48.927537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf6cbd-baf7-4ff5-aed6-5bf575793ca0 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:49.037383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf6cbd-baf7-4ff5-aed6-5bf575793ca0 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:49.049203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94e63-9f50-4ef0-86c6-74c16dd1a0bd None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.049447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94e63-9f50-4ef0-86c6-74c16dd1a0bd None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.049699 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94e63-9f50-4ef0-86c6-74c16dd1a0bd None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.051308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 452/876] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:33:49.056096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83554401-b2b7-433d-9445-53e94ac3fcdc None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.056488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83554401-b2b7-433d-9445-53e94ac3fcdc None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.056925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83554401-b2b7-433d-9445-53e94ac3fcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.075774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfe263-ccfe-4017-be4c-1e1a9eaf2f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:49.076570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-83554401-b2b7-433d-9445-53e94ac3fcdc None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:49.077091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfe263-ccfe-4017-be4c-1e1a9eaf2f05 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.077500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfe263-ccfe-4017-be4c-1e1a9eaf2f05 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.077779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-83554401-b2b7-433d-9445-53e94ac3fcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:49.078066 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfe263-ccfe-4017-be4c-1e1a9eaf2f05 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.078851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfe263-ccfe-4017-be4c-1e1a9eaf2f05 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:49.080385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfe263-ccfe-4017-be4c-1e1a9eaf2f05 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-21cfe263-ccfe-4017-be4c-1e1a9eaf2f05 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:49.094844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:49.095903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:33:49.096740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:49.099307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 425/877] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:33:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:49.105197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfe263-ccfe-4017-be4c-1e1a9eaf2f05 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:49.140670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:49.167596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 453/878] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:49.186693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83554401-b2b7-433d-9445-53e94ac3fcdc None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:49.222969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfe263-ccfe-4017-be4c-1e1a9eaf2f05 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:49.258890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea581f-69f9-4ffd-9dfb-7b4a44a610ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:49.259641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea581f-69f9-4ffd-9dfb-7b4a44a610ab None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.259925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea581f-69f9-4ffd-9dfb-7b4a44a610ab None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.260237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea581f-69f9-4ffd-9dfb-7b4a44a610ab None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.260952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea581f-69f9-4ffd-9dfb-7b4a44a610ab None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:49.261244 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea581f-69f9-4ffd-9dfb-7b4a44a610ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:49.263331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea581f-69f9-4ffd-9dfb-7b4a44a610ab None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:49.272925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 426/879] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:33:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:49.274006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea581f-69f9-4ffd-9dfb-7b4a44a610ab None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:49.279360 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:49.303630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83554401-b2b7-433d-9445-53e94ac3fcdc None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:49.350441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d719-da39-4718-8793-9e6fb8677495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:49.351599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d719-da39-4718-8793-9e6fb8677495 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.351883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d719-da39-4718-8793-9e6fb8677495 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.352162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d719-da39-4718-8793-9e6fb8677495 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.365930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427d719-da39-4718-8793-9e6fb8677495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-1427d719-da39-4718-8793-9e6fb8677495 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:49.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:49.378397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:33:49.379234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:49.383708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 454/880] 10.222.0.78 () {56 vars in 1120 bytes} [Fri Jun 17 08:33:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:49.384703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d719-da39-4718-8793-9e6fb8677495 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:49.399828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:49.411108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea581f-69f9-4ffd-9dfb-7b4a44a610ab None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:49.455332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4ae43-2417-4efc-9687-118cba58281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:49.456275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4ae43-2417-4efc-9687-118cba58281e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.457239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4ae43-2417-4efc-9687-118cba58281e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.457723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4ae43-2417-4efc-9687-118cba58281e None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.458903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4ae43-2417-4efc-9687-118cba58281e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:49.459578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4ae43-2417-4efc-9687-118cba58281e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:49.461765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4ae43-2417-4efc-9687-118cba58281e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:49.473871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 427/881] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:33:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:49.474607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4ae43-2417-4efc-9687-118cba58281e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:49.521267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d719-da39-4718-8793-9e6fb8677495 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:49.560080 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042650f9-c1ab-4afe-b981-aee4d7a088f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:49.561089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042650f9-c1ab-4afe-b981-aee4d7a088f5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.561594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042650f9-c1ab-4afe-b981-aee4d7a088f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.562123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042650f9-c1ab-4afe-b981-aee4d7a088f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.563232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042650f9-c1ab-4afe-b981-aee4d7a088f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:49.563820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042650f9-c1ab-4afe-b981-aee4d7a088f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:49.565416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042650f9-c1ab-4afe-b981-aee4d7a088f5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:49.576341 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 455/882] 10.222.0.78 () {56 vars in 1115 bytes} [Fri Jun 17 08:33:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:49.582068 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042650f9-c1ab-4afe-b981-aee4d7a088f5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:49.585479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:49.596149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4ae43-2417-4efc-9687-118cba58281e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:49.646086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b8803-d573-4b79-870a-82d5658cbab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:49.648121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8803-d573-4b79-870a-82d5658cbab8 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.648434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8803-d573-4b79-870a-82d5658cbab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.648716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8803-d573-4b79-870a-82d5658cbab8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.649515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b8803-d573-4b79-870a-82d5658cbab8 None admin] RBAC: Adding query filter params (interface=public, service_id=304d5294908245f6bf5154f70df43413, region_id=RegionOne) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:49.649829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b8803-d573-4b79-870a-82d5658cbab8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:49.651204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b8803-d573-4b79-870a-82d5658cbab8 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:49.671695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 428/883] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Jun 17 08:33:49 2022] GET /identity/v3/endpoints?service_id=304d5294908245f6bf5154f70df43413&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:49.673951 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b8803-d573-4b79-870a-82d5658cbab8 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:49.705554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:49.710283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042650f9-c1ab-4afe-b981-aee4d7a088f5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:49.749022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e3768-c14d-439b-bb0c-6e8938caf1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:49.749990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e3768-c14d-439b-bb0c-6e8938caf1fe None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.750368 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e3768-c14d-439b-bb0c-6e8938caf1fe None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.751112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e3768-c14d-439b-bb0c-6e8938caf1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.764403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e3768-c14d-439b-bb0c-6e8938caf1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:49.766105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e3768-c14d-439b-bb0c-6e8938caf1fe None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-438e3768-c14d-439b-bb0c-6e8938caf1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:49.787376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:49.788339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:49.789240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:49.789240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:49.789240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:49.789240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:49.794081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 456/884] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:49.795471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e3768-c14d-439b-bb0c-6e8938caf1fe None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:49.820982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b8803-d573-4b79-870a-82d5658cbab8 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:49.861358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7374de-b248-4236-a9fe-408939ee0dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:49.862125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7374de-b248-4236-a9fe-408939ee0dc2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.862412 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7374de-b248-4236-a9fe-408939ee0dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.862687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7374de-b248-4236-a9fe-408939ee0dc2 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.863384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7374de-b248-4236-a9fe-408939ee0dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:49.864759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7374de-b248-4236-a9fe-408939ee0dc2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:49.875407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 429/885] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Jun 17 08:33:49 2022] GET /identity/v3/services => generated 1011 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:33:49.875407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db392-e371-438c-aa17-265c48c08992 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.875407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db392-e371-438c-aa17-265c48c08992 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.875407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db392-e371-438c-aa17-265c48c08992 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.875407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 430/886] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:49.876711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:49.879692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98890b6-6e3e-4feb-ab86-9fe728beff18 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.879976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98890b6-6e3e-4feb-ab86-9fe728beff18 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.880255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98890b6-6e3e-4feb-ab86-9fe728beff18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.898881 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-a98890b6-6e3e-4feb-ab86-9fe728beff18 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:49.900310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a98890b6-6e3e-4feb-ab86-9fe728beff18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:49.937634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e3768-c14d-439b-bb0c-6e8938caf1fe None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:49.976205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546fc2f-2571-4410-867e-25c3c8d2b88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:49.986149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 431/887] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:49.986344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546fc2f-2571-4410-867e-25c3c8d2b88e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.986344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546fc2f-2571-4410-867e-25c3c8d2b88e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.986344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546fc2f-2571-4410-867e-25c3c8d2b88e None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.986593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef65f3-c762-484f-aa11-3e2321860e60 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.986694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546fc2f-2571-4410-867e-25c3c8d2b88e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:49.986783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef65f3-c762-484f-aa11-3e2321860e60 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.986872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546fc2f-2571-4410-867e-25c3c8d2b88e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:49.986953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef65f3-c762-484f-aa11-3e2321860e60 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:49.987050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546fc2f-2571-4410-867e-25c3c8d2b88e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:49.987132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 432/888] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:49.987132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5d752-bff6-4680-8683-700ed370668d None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:49.987132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5d752-bff6-4680-8683-700ed370668d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:49.987132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5d752-bff6-4680-8683-700ed370668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:50.005840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 457/889] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:50.007080 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546fc2f-2571-4410-867e-25c3c8d2b88e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:50.007783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2db5d752-bff6-4680-8683-700ed370668d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:50.009127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2db5d752-bff6-4680-8683-700ed370668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:50.021122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:50.087335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 433/890] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:50.088419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5d752-bff6-4680-8683-700ed370668d None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:50.132458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546fc2f-2571-4410-867e-25c3c8d2b88e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:50.148362 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:50.168261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a4dbd-1509-4889-b2f3-2a7866cd301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:50.169066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a4dbd-1509-4889-b2f3-2a7866cd301d None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:50.169353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a4dbd-1509-4889-b2f3-2a7866cd301d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:50.169818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a4dbd-1509-4889-b2f3-2a7866cd301d None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:50.170545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a4dbd-1509-4889-b2f3-2a7866cd301d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:50.171964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a4dbd-1509-4889-b2f3-2a7866cd301d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:50.195457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5d752-bff6-4680-8683-700ed370668d None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:50.230930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad76f1-d844-4ec1-a1a1-04dea40c2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:50.231793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad76f1-d844-4ec1-a1a1-04dea40c2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:50.232168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad76f1-d844-4ec1-a1a1-04dea40c2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:50.232452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad76f1-d844-4ec1-a1a1-04dea40c2ae4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:50.239508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad76f1-d844-4ec1-a1a1-04dea40c2ae4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:50.243466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad76f1-d844-4ec1-a1a1-04dea40c2ae4 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-73ad76f1-d844-4ec1-a1a1-04dea40c2ae4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:50.256448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:50.257542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 434/891] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Jun 17 08:33:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:50.258468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad76f1-d844-4ec1-a1a1-04dea40c2ae4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:50.265027 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:50.269915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 458/892] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:33:50 2022] POST /identity/v3/services => generated 269 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:50.275611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a4dbd-1509-4889-b2f3-2a7866cd301d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:50.406492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad76f1-d844-4ec1-a1a1-04dea40c2ae4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:50.421763 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a4dbd-1509-4889-b2f3-2a7866cd301d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:50.453978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63b0b2-a57c-4308-a99a-4ae32a53371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:50.454803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63b0b2-a57c-4308-a99a-4ae32a53371f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:50.455082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63b0b2-a57c-4308-a99a-4ae32a53371f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:50.455391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63b0b2-a57c-4308-a99a-4ae32a53371f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:50.456041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63b0b2-a57c-4308-a99a-4ae32a53371f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:50.457498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63b0b2-a57c-4308-a99a-4ae32a53371f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-da63b0b2-a57c-4308-a99a-4ae32a53371f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:50.470159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:50.471280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:50.472230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 435/893] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:33:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:50.473364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9f9bc-0362-4cba-8945-275ef53906fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:50.474244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9f9bc-0362-4cba-8945-275ef53906fd None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:50.474535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9f9bc-0362-4cba-8945-275ef53906fd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:50.474819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9f9bc-0362-4cba-8945-275ef53906fd None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:50.476233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9f9bc-0362-4cba-8945-275ef53906fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:50.476233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9f9bc-0362-4cba-8945-275ef53906fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:50.477407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63b0b2-a57c-4308-a99a-4ae32a53371f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:50.477532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9f9bc-0362-4cba-8945-275ef53906fd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:50.501091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 459/894] 10.222.0.78 () {56 vars in 1149 bytes} [Fri Jun 17 08:33:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:50.507909 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9f9bc-0362-4cba-8945-275ef53906fd None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:50.539068 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:50.572367 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:50.611314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63b0b2-a57c-4308-a99a-4ae32a53371f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:50.623549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9f9bc-0362-4cba-8945-275ef53906fd None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:50.649076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639beaf-8e23-42fb-b13f-0151f2056282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:50.649849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639beaf-8e23-42fb-b13f-0151f2056282 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:50.650199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639beaf-8e23-42fb-b13f-0151f2056282 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:50.650542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639beaf-8e23-42fb-b13f-0151f2056282 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:50.651340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639beaf-8e23-42fb-b13f-0151f2056282 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:50.651744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639beaf-8e23-42fb-b13f-0151f2056282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:50.655184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639beaf-8e23-42fb-b13f-0151f2056282 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:50.663522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 436/895] 10.222.0.78 () {56 vars in 1122 bytes} [Fri Jun 17 08:33:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:50.667119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639beaf-8e23-42fb-b13f-0151f2056282 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:50.670862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb53dd-32af-4372-9c07-bb95017e9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:50.672119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb53dd-32af-4372-9c07-bb95017e9648 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:50.675600 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb53dd-32af-4372-9c07-bb95017e9648 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:50.676137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb53dd-32af-4372-9c07-bb95017e9648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:50.756515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb53dd-32af-4372-9c07-bb95017e9648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:50.758321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb53dd-32af-4372-9c07-bb95017e9648 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:50.781804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639beaf-8e23-42fb-b13f-0151f2056282 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:50.789621 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:50.814627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:50.820079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b721e-4859-4f9e-82e8-97cb75871b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:50.820978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b721e-4859-4f9e-82e8-97cb75871b2c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:50.821475 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b721e-4859-4f9e-82e8-97cb75871b2c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:50.822384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b721e-4859-4f9e-82e8-97cb75871b2c None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:50.823277 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b721e-4859-4f9e-82e8-97cb75871b2c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:50.823841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b721e-4859-4f9e-82e8-97cb75871b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:50.826268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b721e-4859-4f9e-82e8-97cb75871b2c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:50.839862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 437/896] 10.222.0.78 () {56 vars in 1122 bytes} [Fri Jun 17 08:33:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:50.878017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 460/897] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:50 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:33:50.883254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b721e-4859-4f9e-82e8-97cb75871b2c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:51.004181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b721e-4859-4f9e-82e8-97cb75871b2c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:51.046619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a507f-aee7-4dc0-beb6-a0b567e49b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:51.047835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a507f-aee7-4dc0-beb6-a0b567e49b53 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:51.048318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a507f-aee7-4dc0-beb6-a0b567e49b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:51.048788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a507f-aee7-4dc0-beb6-a0b567e49b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:51.061619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a507f-aee7-4dc0-beb6-a0b567e49b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:51.063446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a507f-aee7-4dc0-beb6-a0b567e49b53 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-071a507f-aee7-4dc0-beb6-a0b567e49b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:51.082817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:51.083794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:51.084773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:51.084773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:51.084773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:51.084773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:51.087058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 438/898] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:51.092936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb53dd-32af-4372-9c07-bb95017e9648 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:51.198013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb53dd-32af-4372-9c07-bb95017e9648 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:51.226361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:51.235169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f393b-a0d2-45e9-8070-cfcc70a6025d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:51.235868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f393b-a0d2-45e9-8070-cfcc70a6025d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:51.236156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f393b-a0d2-45e9-8070-cfcc70a6025d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:51.236435 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f393b-a0d2-45e9-8070-cfcc70a6025d None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:51.237159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f393b-a0d2-45e9-8070-cfcc70a6025d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:51.237464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f393b-a0d2-45e9-8070-cfcc70a6025d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:51.238841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f393b-a0d2-45e9-8070-cfcc70a6025d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:51.252450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 461/899] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:51.258100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a507f-aee7-4dc0-beb6-a0b567e49b53 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:51.311195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:51.382671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a507f-aee7-4dc0-beb6-a0b567e49b53 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:51.422391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494ba28-ee50-4a3e-97e0-8872339fe270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:51.423648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494ba28-ee50-4a3e-97e0-8872339fe270 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:51.424172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494ba28-ee50-4a3e-97e0-8872339fe270 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:51.424646 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494ba28-ee50-4a3e-97e0-8872339fe270 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:51.432601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494ba28-ee50-4a3e-97e0-8872339fe270 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:51.434362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494ba28-ee50-4a3e-97e0-8872339fe270 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-f494ba28-ee50-4a3e-97e0-8872339fe270 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:51.451669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:51.452565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:51.453465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:51.453465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:51.453465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:51.453465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:51.453465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:51.453465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:51.453465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:51.453465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:51.455948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 439/900] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:51.461986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f393b-a0d2-45e9-8070-cfcc70a6025d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:51.573589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f393b-a0d2-45e9-8070-cfcc70a6025d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:51.610636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315af00c-f332-4b8a-811a-7794a8b95299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:51.611670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af00c-f332-4b8a-811a-7794a8b95299 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:51.612098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af00c-f332-4b8a-811a-7794a8b95299 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:51.612517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315af00c-f332-4b8a-811a-7794a8b95299 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:51.613465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315af00c-f332-4b8a-811a-7794a8b95299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:51.613938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315af00c-f332-4b8a-811a-7794a8b95299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:51.615666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315af00c-f332-4b8a-811a-7794a8b95299 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:51.629399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 462/901] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:51.635664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494ba28-ee50-4a3e-97e0-8872339fe270 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:51.744408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494ba28-ee50-4a3e-97e0-8872339fe270 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:51.755261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:51.782980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2002d3c-5ae4-43bc-bc97-d7e5481c1c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:51.783674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002d3c-5ae4-43bc-bc97-d7e5481c1c3a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:51.784132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002d3c-5ae4-43bc-bc97-d7e5481c1c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:51.784418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002d3c-5ae4-43bc-bc97-d7e5481c1c3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:51.785288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2002d3c-5ae4-43bc-bc97-d7e5481c1c3a None admin] RBAC: Adding query filter params (role.id=ce0dd8032e4943a59fd5fc51178f7aff, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=7687888c51224d8e94018f35a82fbcc4) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:51.785607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2002d3c-5ae4-43bc-bc97-d7e5481c1c3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:51.787046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2002d3c-5ae4-43bc-bc97-d7e5481c1c3a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:51.793683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 440/902] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:33:51 2022] GET /identity/v3/role_assignments?user.id=7687888c51224d8e94018f35a82fbcc4&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=ce0dd8032e4943a59fd5fc51178f7aff => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:52.095836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9c8a-b781-4809-a0df-d22958e58b9d None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:52.096398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9c8a-b781-4809-a0df-d22958e58b9d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:52.096398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9c8a-b781-4809-a0df-d22958e58b9d None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:52.098105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 463/903] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:52.104103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef5b0a-e2e0-4cbc-9bc0-bdf2026ec190 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:52.104583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef5b0a-e2e0-4cbc-9bc0-bdf2026ec190 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:52.104660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef5b0a-e2e0-4cbc-9bc0-bdf2026ec190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:52.122958 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-15ef5b0a-e2e0-4cbc-9bc0-bdf2026ec190 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:52.124407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-15ef5b0a-e2e0-4cbc-9bc0-bdf2026ec190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:52.198854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 441/904] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:52.223399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de9c8a-b781-4809-a0df-d22958e58b9d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:52.282851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:52.337302 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de9c8a-b781-4809-a0df-d22958e58b9d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:52.373688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df4c19-c095-479c-8693-9b287d167e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:52.374413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4c19-c095-479c-8693-9b287d167e02 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:52.374700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4c19-c095-479c-8693-9b287d167e02 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:52.374983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4c19-c095-479c-8693-9b287d167e02 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:52.375677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df4c19-c095-479c-8693-9b287d167e02 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:52.377052 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df4c19-c095-479c-8693-9b287d167e02 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-f4df4c19-c095-479c-8693-9b287d167e02 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:52.389933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:52.390922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:52.391785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 464/905] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:33:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:52.398960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef5b0a-e2e0-4cbc-9bc0-bdf2026ec190 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:52.520368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef5b0a-e2e0-4cbc-9bc0-bdf2026ec190 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:52.522606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:52.558707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e143d1-e261-4449-87cc-d50d204daa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:52.560146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e143d1-e261-4449-87cc-d50d204daa95 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:52.560578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e143d1-e261-4449-87cc-d50d204daa95 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:52.560866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e143d1-e261-4449-87cc-d50d204daa95 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:52.561581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e143d1-e261-4449-87cc-d50d204daa95 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:52.561889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e143d1-e261-4449-87cc-d50d204daa95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:52.563277 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e143d1-e261-4449-87cc-d50d204daa95 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:52.566717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4125a-4bad-418f-a118-6ba7b65a01cd None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:52.567007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4125a-4bad-418f-a118-6ba7b65a01cd None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:52.567288 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4125a-4bad-418f-a118-6ba7b65a01cd None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:52.568922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 465/906] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:52.571816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 442/907] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:33:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:52.578273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4125a-4bad-418f-a118-6ba7b65a01cd None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:52.578969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aca4b-e711-4777-ab0a-f3c2f59b9fdf None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:52.579548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aca4b-e711-4777-ab0a-f3c2f59b9fdf None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:52.580041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5aca4b-e711-4777-ab0a-f3c2f59b9fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:52.603671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-cc5aca4b-e711-4777-ab0a-f3c2f59b9fdf None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:52.605444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-cc5aca4b-e711-4777-ab0a-f3c2f59b9fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:52.682154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 443/908] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:52.697845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4125a-4bad-418f-a118-6ba7b65a01cd None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:52.705356 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aca4b-e711-4777-ab0a-f3c2f59b9fdf None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:52.714224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:52.738433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73a208-2863-494a-8304-b7433de0a000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:52.739087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73a208-2863-494a-8304-b7433de0a000 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:52.739398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73a208-2863-494a-8304-b7433de0a000 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:52.739729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73a208-2863-494a-8304-b7433de0a000 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:52.740552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73a208-2863-494a-8304-b7433de0a000 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:52.741028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73a208-2863-494a-8304-b7433de0a000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:52.742558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73a208-2863-494a-8304-b7433de0a000 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:52.750123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 466/909] 10.222.0.78 () {56 vars in 1114 bytes} [Fri Jun 17 08:33:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:52.757395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73a208-2863-494a-8304-b7433de0a000 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:52.827165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:52.834150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5aca4b-e711-4777-ab0a-f3c2f59b9fdf None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:52.874510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73a208-2863-494a-8304-b7433de0a000 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:52.880211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f6246-ff5a-4087-aa7f-7358dadf160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:52.881307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f6246-ff5a-4087-aa7f-7358dadf160a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:52.881765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f6246-ff5a-4087-aa7f-7358dadf160a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:52.882226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f6246-ff5a-4087-aa7f-7358dadf160a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:52.883050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f6246-ff5a-4087-aa7f-7358dadf160a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:52.885113 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f6246-ff5a-4087-aa7f-7358dadf160a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-3f3f6246-ff5a-4087-aa7f-7358dadf160a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:52.902409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:52.904405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:33:52.905333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:52.906111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 444/910] 10.222.0.78 () {56 vars in 1132 bytes} [Fri Jun 17 08:33:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:33:52.911943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f6246-ff5a-4087-aa7f-7358dadf160a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:52.925075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c2530-b337-4b3f-9fe2-6c4db3b13843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:52.925814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c2530-b337-4b3f-9fe2-6c4db3b13843 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:52.926105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c2530-b337-4b3f-9fe2-6c4db3b13843 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:52.926384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c2530-b337-4b3f-9fe2-6c4db3b13843 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:52.927211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c2530-b337-4b3f-9fe2-6c4db3b13843 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:52.928891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c2530-b337-4b3f-9fe2-6c4db3b13843 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:53.022574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 467/911] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Jun 17 08:33:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:53.034085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f6246-ff5a-4087-aa7f-7358dadf160a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:53.084662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee98c5b-625c-4e38-83d1-fa5a20413a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:53.085359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee98c5b-625c-4e38-83d1-fa5a20413a2f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:53.085640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee98c5b-625c-4e38-83d1-fa5a20413a2f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:53.085915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee98c5b-625c-4e38-83d1-fa5a20413a2f None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:53.086642 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee98c5b-625c-4e38-83d1-fa5a20413a2f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:53.087026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee98c5b-625c-4e38-83d1-fa5a20413a2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:53.088555 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee98c5b-625c-4e38-83d1-fa5a20413a2f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:53.095573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 445/912] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:33:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:53.104930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c2530-b337-4b3f-9fe2-6c4db3b13843 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:53.142476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:53.228228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c2530-b337-4b3f-9fe2-6c4db3b13843 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:53.259710 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983383b2-4317-4bcc-9147-9f7e824811f9 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:53.260249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983383b2-4317-4bcc-9147-9f7e824811f9 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:53.260249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983383b2-4317-4bcc-9147-9f7e824811f9 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:53.261756 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 446/913] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:33:53.265935 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b5dad-3c2e-45c5-872c-a27c337842a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:53.266611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b5dad-3c2e-45c5-872c-a27c337842a0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:53.266892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b5dad-3c2e-45c5-872c-a27c337842a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:53.267170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b5dad-3c2e-45c5-872c-a27c337842a0 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:53.267284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847168f3-d16f-4f5d-a6b9-36f0ddff7598 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:53.267566 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847168f3-d16f-4f5d-a6b9-36f0ddff7598 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:53.267854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847168f3-d16f-4f5d-a6b9-36f0ddff7598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:53.267962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b5dad-3c2e-45c5-872c-a27c337842a0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:53.268212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b5dad-3c2e-45c5-872c-a27c337842a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:53.269693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b5dad-3c2e-45c5-872c-a27c337842a0 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:53.275504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 468/914] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:33:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:53.281705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b5dad-3c2e-45c5-872c-a27c337842a0 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:53.287925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-847168f3-d16f-4f5d-a6b9-36f0ddff7598 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:53.289396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-847168f3-d16f-4f5d-a6b9-36f0ddff7598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:53.311288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:53.386716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:53.393840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b5dad-3c2e-45c5-872c-a27c337842a0 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:53.395700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 447/915] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:53.418326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847168f3-d16f-4f5d-a6b9-36f0ddff7598 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:53.436346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbef4d-ca41-4b0e-a872-eb5f9df9131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:53.437444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbef4d-ca41-4b0e-a872-eb5f9df9131d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:53.437925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbef4d-ca41-4b0e-a872-eb5f9df9131d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:53.438478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbef4d-ca41-4b0e-a872-eb5f9df9131d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:53.440032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbef4d-ca41-4b0e-a872-eb5f9df9131d None admin] RBAC: Adding query filter params (interface=public, service_id=13585c3838e345a88bc476538dcde185, region_id=RegionOne) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:53.440586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbef4d-ca41-4b0e-a872-eb5f9df9131d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:53.442315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbef4d-ca41-4b0e-a872-eb5f9df9131d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:53.452937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 469/916] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Jun 17 08:33:53 2022] GET /identity/v3/endpoints?service_id=13585c3838e345a88bc476538dcde185&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:53.458274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbef4d-ca41-4b0e-a872-eb5f9df9131d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:53.547977 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847168f3-d16f-4f5d-a6b9-36f0ddff7598 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:53.579861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbef4d-ca41-4b0e-a872-eb5f9df9131d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:53.588814 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437f8e5-d766-4189-9bed-654abb5dedb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:53.589493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437f8e5-d766-4189-9bed-654abb5dedb6 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:53.589770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437f8e5-d766-4189-9bed-654abb5dedb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:53.590042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437f8e5-d766-4189-9bed-654abb5dedb6 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:53.591509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437f8e5-d766-4189-9bed-654abb5dedb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:53.592961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437f8e5-d766-4189-9bed-654abb5dedb6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:53.620201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b82cec-f83e-4e86-971f-8197625a0ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:53.620925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b82cec-f83e-4e86-971f-8197625a0ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:53.621207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b82cec-f83e-4e86-971f-8197625a0ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:53.621483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b82cec-f83e-4e86-971f-8197625a0ae5 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:53.622175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b82cec-f83e-4e86-971f-8197625a0ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:53.623605 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b82cec-f83e-4e86-971f-8197625a0ae5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:53.629946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 470/917] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Jun 17 08:33:53 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:33:53.669993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 448/918] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:33:53 2022] POST /identity/v3/services => generated 241 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:33:54.030888 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc079-9a49-4607-8c6e-ad03106603ab None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:54.031196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc079-9a49-4607-8c6e-ad03106603ab None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:54.031497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cc079-9a49-4607-8c6e-ad03106603ab None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:54.033124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 471/919] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:54.038337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76e65-e076-406c-a194-013f5e14aff5 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:54.038622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76e65-e076-406c-a194-013f5e14aff5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:54.038896 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76e65-e076-406c-a194-013f5e14aff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:54.056642 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ecc76e65-e076-406c-a194-013f5e14aff5 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:54.057831 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ecc76e65-e076-406c-a194-013f5e14aff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:54.061428 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:54.135329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 449/920] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:54.158683 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cc079-9a49-4607-8c6e-ad03106603ab None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:54.185617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:54.271216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cc079-9a49-4607-8c6e-ad03106603ab None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:54.307582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b9b31-c345-4bc6-ab17-056b2fa45c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:54.308331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b9b31-c345-4bc6-ab17-056b2fa45c1f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:54.308616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b9b31-c345-4bc6-ab17-056b2fa45c1f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:54.308897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b9b31-c345-4bc6-ab17-056b2fa45c1f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:54.321061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b9b31-c345-4bc6-ab17-056b2fa45c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ec6b9b31-c345-4bc6-ab17-056b2fa45c1f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:54.329779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:54.330704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:54.332354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 472/921] 10.222.0.78 () {56 vars in 1120 bytes} [Fri Jun 17 08:33:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:54.337413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76e65-e076-406c-a194-013f5e14aff5 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:54.448789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76e65-e076-406c-a194-013f5e14aff5 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:54.489033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b62ff0-d4d7-4882-abdf-f1b15a866a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:54.489708 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b62ff0-d4d7-4882-abdf-f1b15a866a79 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:54.489987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b62ff0-d4d7-4882-abdf-f1b15a866a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:54.490263 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b62ff0-d4d7-4882-abdf-f1b15a866a79 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:54.491002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b62ff0-d4d7-4882-abdf-f1b15a866a79 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:54.491304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b62ff0-d4d7-4882-abdf-f1b15a866a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:54.492695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b62ff0-d4d7-4882-abdf-f1b15a866a79 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:54.501363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 450/922] 10.222.0.78 () {56 vars in 1115 bytes} [Fri Jun 17 08:33:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:54.501686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:54.508527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b9b31-c345-4bc6-ab17-056b2fa45c1f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:54.600208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:54.618025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b9b31-c345-4bc6-ab17-056b2fa45c1f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:54.655257 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafc44a-3bb9-462b-bf36-240655109dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:54.656084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafc44a-3bb9-462b-bf36-240655109dc6 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:54.656366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafc44a-3bb9-462b-bf36-240655109dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:54.656643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafc44a-3bb9-462b-bf36-240655109dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:54.667198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafc44a-3bb9-462b-bf36-240655109dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:54.669538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafc44a-3bb9-462b-bf36-240655109dc6 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-0eafc44a-3bb9-462b-bf36-240655109dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:54.688829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:54.690939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:54.693167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:54.693167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:54.693167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:54.693167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:54.693167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 473/923] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:54.696431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b62ff0-d4d7-4882-abdf-f1b15a866a79 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:54.807520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b62ff0-d4d7-4882-abdf-f1b15a866a79 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:54.844811 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef712633-0679-490a-b2af-24ff31bf23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:54.845862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef712633-0679-490a-b2af-24ff31bf23a4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:54.846340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef712633-0679-490a-b2af-24ff31bf23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:54.846806 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef712633-0679-490a-b2af-24ff31bf23a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:54.847790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef712633-0679-490a-b2af-24ff31bf23a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:54.848307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef712633-0679-490a-b2af-24ff31bf23a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:54.849857 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef712633-0679-490a-b2af-24ff31bf23a4 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:54.863341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 451/924] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:54.875411 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafc44a-3bb9-462b-bf36-240655109dc6 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:54.978161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafc44a-3bb9-462b-bf36-240655109dc6 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:55.018904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb47b-c662-423d-bd5b-b4b15ae7368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:55.019880 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb47b-c662-423d-bd5b-b4b15ae7368e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:55.020344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb47b-c662-423d-bd5b-b4b15ae7368e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:55.020674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb47b-c662-423d-bd5b-b4b15ae7368e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:55.024007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:55.029777 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fb47b-c662-423d-bd5b-b4b15ae7368e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:55.031486 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fb47b-c662-423d-bd5b-b4b15ae7368e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-cb4fb47b-c662-423d-bd5b-b4b15ae7368e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:55.047999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:55.048988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:55.050351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 474/925] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Jun 17 08:33:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:55.055155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef712633-0679-490a-b2af-24ff31bf23a4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:55.117399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:55.160388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef712633-0679-490a-b2af-24ff31bf23a4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:55.199248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ef473-be4b-41b7-a86e-2cca6a10f45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:55.200598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef473-be4b-41b7-a86e-2cca6a10f45c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:55.201086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef473-be4b-41b7-a86e-2cca6a10f45c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:55.201551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef473-be4b-41b7-a86e-2cca6a10f45c None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:55.202587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ef473-be4b-41b7-a86e-2cca6a10f45c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:55.203091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ef473-be4b-41b7-a86e-2cca6a10f45c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:55.204727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ef473-be4b-41b7-a86e-2cca6a10f45c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:55.222926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 452/926] 10.222.0.78 () {56 vars in 1149 bytes} [Fri Jun 17 08:33:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:55.228199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb47b-c662-423d-bd5b-b4b15ae7368e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:55.335939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3380f0-a9b3-4075-96f3-a43a7d1379dc None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:55.336615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3380f0-a9b3-4075-96f3-a43a7d1379dc None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:55.337100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3380f0-a9b3-4075-96f3-a43a7d1379dc None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:55.339864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb47b-c662-423d-bd5b-b4b15ae7368e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:55.340123 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 453/927] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:55.345271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f640d-119a-4cb7-a80b-532f3ad65087 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:55.345788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f640d-119a-4cb7-a80b-532f3ad65087 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:55.346263 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f640d-119a-4cb7-a80b-532f3ad65087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:55.363641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-011f640d-119a-4cb7-a80b-532f3ad65087 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:55.365141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-011f640d-119a-4cb7-a80b-532f3ad65087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:55.376550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e9fe-2c4e-458c-abd9-c38175d9b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:55.377286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e9fe-2c4e-458c-abd9-c38175d9b703 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:55.377872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e9fe-2c4e-458c-abd9-c38175d9b703 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:55.378211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e9fe-2c4e-458c-abd9-c38175d9b703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:55.392185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553e9fe-2c4e-458c-abd9-c38175d9b703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:55.393940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553e9fe-2c4e-458c-abd9-c38175d9b703 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-0553e9fe-2c4e-458c-abd9-c38175d9b703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:55.414790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:55.415807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:55.416702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:55.416702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:55.416702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:55.416702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:55.419512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 475/928] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:55.424893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e9fe-2c4e-458c-abd9-c38175d9b703 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:55.455476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 454/929] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:55.474086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f640d-119a-4cb7-a80b-532f3ad65087 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:55.483254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:55.535739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:55.553157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e9fe-2c4e-458c-abd9-c38175d9b703 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:55.582900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f640d-119a-4cb7-a80b-532f3ad65087 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:55.598493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ea7ca-40cd-428b-b6c7-da3f0b1a08f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:55.599460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ea7ca-40cd-428b-b6c7-da3f0b1a08f4 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:55.599748 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ea7ca-40cd-428b-b6c7-da3f0b1a08f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:55.600027 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ea7ca-40cd-428b-b6c7-da3f0b1a08f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:55.601019 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ea7ca-40cd-428b-b6c7-da3f0b1a08f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:55.601712 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ea7ca-40cd-428b-b6c7-da3f0b1a08f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:55.603204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ea7ca-40cd-428b-b6c7-da3f0b1a08f4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:55.619633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:55.620387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:55.620737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:55.621156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:55.621969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:55.623532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:55.624868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 476/930] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:55.625471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: WARNING keystone.server.flask.common [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 17 08:33:55.625759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ea7ca-40cd-428b-b6c7-da3f0b1a08f4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:55.679404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.sql.core [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 08:33:55.679404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 08:33:55.679404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [parameters: {'id': '1cd0d8991a9b4b9c89a6eb6672d855c0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 08:33:55.679404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87052) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1cd0d8991a9b4b9c89a6eb6672d855c0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1cd0d8991a9b4b9c89a6eb6672d855c0. Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:33:55.697258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application result.read() Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 17 08:33:55.698167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application yield resource Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise self.value Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application session.commit() Jun 17 08:33:55.699147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self.session.flush() Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application compat.raise_( Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 08:33:55.701474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 08:33:55.702376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application result.read() Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:33:55.703233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [parameters: {'id': '1cd0d8991a9b4b9c89a6eb6672d855c0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:55.705745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:55.707595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1cd0d8991a9b4b9c89a6eb6672d855c0. Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 455/931] 10.222.0.78 () {60 vars in 1140 bytes} [Fri Jun 17 08:33:55 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:55.711452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:55.770881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ea7ca-40cd-428b-b6c7-da3f0b1a08f4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:55.782113 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:55.810226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25abea-8460-4026-85a1-b1239c1e1648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:55.811454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25abea-8460-4026-85a1-b1239c1e1648 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:55.811914 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25abea-8460-4026-85a1-b1239c1e1648 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:55.812405 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25abea-8460-4026-85a1-b1239c1e1648 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:55.820864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25abea-8460-4026-85a1-b1239c1e1648 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:55.822531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25abea-8460-4026-85a1-b1239c1e1648 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:55.823557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfa2a4-09e8-4099-a0a9-eb25a4c2945e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:55.825933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ab25abea-8460-4026-85a1-b1239c1e1648 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:55.840053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:55.847845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:55.848770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:55.848770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:55.848770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:55.848770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:55.848770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:55.848770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:55.848770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:55.848770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:55.849641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 477/932] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:55.850876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25abea-8460-4026-85a1-b1239c1e1648 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:55.868935 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8ff45-85c8-4004-9385-519c2e704c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:55.869927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8ff45-85c8-4004-9385-519c2e704c4a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:55.870271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8ff45-85c8-4004-9385-519c2e704c4a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:55.870607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8ff45-85c8-4004-9385-519c2e704c4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:55.879557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8ff45-85c8-4004-9385-519c2e704c4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:55.881331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8ff45-85c8-4004-9385-519c2e704c4a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-f9b8ff45-85c8-4004-9385-519c2e704c4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:33:55.898612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:55.899636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:55.900552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:33:55.900552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:33:55.900552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:33:55.900552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:33:55.900552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:33:55.900552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:33:55.900552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:33:55.900552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:55.906045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 456/933] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:55.908629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8ff45-85c8-4004-9385-519c2e704c4a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:55.973510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25abea-8460-4026-85a1-b1239c1e1648 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:56.007556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b3dc4-e1a7-4441-9175-d4f2160c3889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:56.008209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b3dc4-e1a7-4441-9175-d4f2160c3889 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.008490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b3dc4-e1a7-4441-9175-d4f2160c3889 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.008839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b3dc4-e1a7-4441-9175-d4f2160c3889 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.009655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b3dc4-e1a7-4441-9175-d4f2160c3889 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:56.009967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b3dc4-e1a7-4441-9175-d4f2160c3889 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:56.011408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b3dc4-e1a7-4441-9175-d4f2160c3889 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:56.014289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8ff45-85c8-4004-9385-519c2e704c4a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:56.023583 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 478/934] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:56.024913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b120-4fe0-4903-89fc-8604c7deacd1 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.025223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b120-4fe0-4903-89fc-8604c7deacd1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.025502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920b120-4fe0-4903-89fc-8604c7deacd1 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.026734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 479/935] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:56.027928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab059291-14c3-4d9f-903c-2c7c9169a5c6 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.029022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab059291-14c3-4d9f-903c-2c7c9169a5c6 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.029291 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab059291-14c3-4d9f-903c-2c7c9169a5c6 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.030616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 480/936] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:56.031308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab059291-14c3-4d9f-903c-2c7c9169a5c6 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:56.054898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93e485-15db-41f1-9ddf-936ca96f93bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:56.055589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93e485-15db-41f1-9ddf-936ca96f93bd None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.055870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93e485-15db-41f1-9ddf-936ca96f93bd None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.056145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93e485-15db-41f1-9ddf-936ca96f93bd None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.056892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93e485-15db-41f1-9ddf-936ca96f93bd None admin] RBAC: Adding query filter params (name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:56.057196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93e485-15db-41f1-9ddf-936ca96f93bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:56.058624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93e485-15db-41f1-9ddf-936ca96f93bd None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:56.061825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:56.079665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 457/937] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:33:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:56.080974 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbef388-8d22-428f-bf99-849d93385f43 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.081259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbef388-8d22-428f-bf99-849d93385f43 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.081532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbef388-8d22-428f-bf99-849d93385f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.100288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-bfbef388-8d22-428f-bf99-849d93385f43 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:56.101871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-bfbef388-8d22-428f-bf99-849d93385f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:56.121211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:56.152628 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab059291-14c3-4d9f-903c-2c7c9169a5c6 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:56.187433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 458/938] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:56.187433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990020b0-9f1f-4632-a097-3d3653fc6baa None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.187433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990020b0-9f1f-4632-a097-3d3653fc6baa None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.187433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990020b0-9f1f-4632-a097-3d3653fc6baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.196470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df351a94-49d7-4b53-b485-a8b38ff42628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:56.197448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df351a94-49d7-4b53-b485-a8b38ff42628 None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.197735 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df351a94-49d7-4b53-b485-a8b38ff42628 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.198106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df351a94-49d7-4b53-b485-a8b38ff42628 None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/7687888c51224d8e94018f35a82fbcc4/roles/ce0dd8032e4943a59fd5fc51178f7aff` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.201448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df351a94-49d7-4b53-b485-a8b38ff42628 None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=7687888c51224d8e94018f35a82fbcc4, role_id=ce0dd8032e4943a59fd5fc51178f7aff)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:56.202994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df351a94-49d7-4b53-b485-a8b38ff42628 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:56.203374 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-990020b0-9f1f-4632-a097-3d3653fc6baa None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:56.204594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-990020b0-9f1f-4632-a097-3d3653fc6baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:56.276748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 459/939] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:56.277606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990020b0-9f1f-4632-a097-3d3653fc6baa None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:56.333343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 481/940] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:33:56 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/7687888c51224d8e94018f35a82fbcc4/roles/ce0dd8032e4943a59fd5fc51178f7aff => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:33:56.334186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df351a94-49d7-4b53-b485-a8b38ff42628 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:56.372484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:56.400297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990020b0-9f1f-4632-a097-3d3653fc6baa None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:56.455869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1542ba4-cc6a-4865-bd35-275596bf439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:56.456982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542ba4-cc6a-4865-bd35-275596bf439c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.457274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542ba4-cc6a-4865-bd35-275596bf439c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.457879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542ba4-cc6a-4865-bd35-275596bf439c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.458654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1542ba4-cc6a-4865-bd35-275596bf439c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:56.460954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1542ba4-cc6a-4865-bd35-275596bf439c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:56.468537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-d1542ba4-cc6a-4865-bd35-275596bf439c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:56.479797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:56.480876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 08:33:56.481733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:56.483489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 460/941] 10.222.0.78 () {56 vars in 1132 bytes} [Fri Jun 17 08:33:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:56.489143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1542ba4-cc6a-4865-bd35-275596bf439c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:56.491172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df351a94-49d7-4b53-b485-a8b38ff42628 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:56.545142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c151030-e8a5-40ef-a9e9-93945be38ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:56.545887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c151030-e8a5-40ef-a9e9-93945be38ef0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.546167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c151030-e8a5-40ef-a9e9-93945be38ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.546444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c151030-e8a5-40ef-a9e9-93945be38ef0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.547102 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c151030-e8a5-40ef-a9e9-93945be38ef0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:56.548511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c151030-e8a5-40ef-a9e9-93945be38ef0 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-3c151030-e8a5-40ef-a9e9-93945be38ef0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:56.563410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:56.564466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:56.565299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 482/942] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:33:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:56.570714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c151030-e8a5-40ef-a9e9-93945be38ef0 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:56.638943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1542ba4-cc6a-4865-bd35-275596bf439c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:56.681373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c151030-e8a5-40ef-a9e9-93945be38ef0 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:56.686660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cb8ea-5081-43d6-9ca4-bb697ee20eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:56.687573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cb8ea-5081-43d6-9ca4-bb697ee20eac None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.688010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cb8ea-5081-43d6-9ca4-bb697ee20eac None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.688465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cb8ea-5081-43d6-9ca4-bb697ee20eac None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.689323 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cb8ea-5081-43d6-9ca4-bb697ee20eac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:56.690318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cb8ea-5081-43d6-9ca4-bb697ee20eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:56.692364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cb8ea-5081-43d6-9ca4-bb697ee20eac None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:56.705185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 461/943] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:33:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:56.706145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cb8ea-5081-43d6-9ca4-bb697ee20eac None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:56.726578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cac2f-04c0-4c72-9cd5-0fd7cef8baf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:56.727316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cac2f-04c0-4c72-9cd5-0fd7cef8baf5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.727644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cac2f-04c0-4c72-9cd5-0fd7cef8baf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.727977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cac2f-04c0-4c72-9cd5-0fd7cef8baf5 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.728894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cac2f-04c0-4c72-9cd5-0fd7cef8baf5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:56.729093 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cac2f-04c0-4c72-9cd5-0fd7cef8baf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:56.730515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cac2f-04c0-4c72-9cd5-0fd7cef8baf5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:56.737147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:56.740969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 483/944] 10.222.0.78 () {56 vars in 1122 bytes} [Fri Jun 17 08:33:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:56.741976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cac2f-04c0-4c72-9cd5-0fd7cef8baf5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:56.764232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:56.836193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cb8ea-5081-43d6-9ca4-bb697ee20eac None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:56.869252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cac2f-04c0-4c72-9cd5-0fd7cef8baf5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:56.875964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261b6ce-a0d0-4afb-9682-52ca692344d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:56.876643 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261b6ce-a0d0-4afb-9682-52ca692344d8 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.876928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261b6ce-a0d0-4afb-9682-52ca692344d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.877272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261b6ce-a0d0-4afb-9682-52ca692344d8 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.877992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261b6ce-a0d0-4afb-9682-52ca692344d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:56.878304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261b6ce-a0d0-4afb-9682-52ca692344d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:56.879872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261b6ce-a0d0-4afb-9682-52ca692344d8 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:56.892446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 462/945] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:33:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:56.893453 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261b6ce-a0d0-4afb-9682-52ca692344d8 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:56.923736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd173ff-14ba-41cb-a52e-8e82d214efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:56.925423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd173ff-14ba-41cb-a52e-8e82d214efae None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:56.926065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd173ff-14ba-41cb-a52e-8e82d214efae None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:56.926675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd173ff-14ba-41cb-a52e-8e82d214efae None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:56.927956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd173ff-14ba-41cb-a52e-8e82d214efae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:56.928883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd173ff-14ba-41cb-a52e-8e82d214efae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:56.930727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd173ff-14ba-41cb-a52e-8e82d214efae None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:56.937748 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 484/946] 10.222.0.78 () {56 vars in 1122 bytes} [Fri Jun 17 08:33:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:56.944527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd173ff-14ba-41cb-a52e-8e82d214efae None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:56.989106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:57.014510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261b6ce-a0d0-4afb-9682-52ca692344d8 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:57.053259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6787f53-5423-49f4-b8f7-9afeec33590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:57.053865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:57.053998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6787f53-5423-49f4-b8f7-9afeec33590e None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:57.054382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6787f53-5423-49f4-b8f7-9afeec33590e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:57.055074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6787f53-5423-49f4-b8f7-9afeec33590e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:57.056062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6787f53-5423-49f4-b8f7-9afeec33590e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:57.057347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6787f53-5423-49f4-b8f7-9afeec33590e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:57.076618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd173ff-14ba-41cb-a52e-8e82d214efae None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:57.112879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0f85e-36bf-460c-9938-1af3b8e186aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:57.113937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f85e-36bf-460c-9938-1af3b8e186aa None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:57.114459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f85e-36bf-460c-9938-1af3b8e186aa None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:57.114965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f85e-36bf-460c-9938-1af3b8e186aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:57.115991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0f85e-36bf-460c-9938-1af3b8e186aa None admin] RBAC: Adding query filter params (interface=public, service_id=7e6649c113f3418b81ab29c23867bf5f, region_id=RegionOne) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:57.116501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0f85e-36bf-460c-9938-1af3b8e186aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:57.118103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0f85e-36bf-460c-9938-1af3b8e186aa None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:57.128549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 485/947] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Jun 17 08:33:56 2022] GET /identity/v3/endpoints?service_id=7e6649c113f3418b81ab29c23867bf5f&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:57.132212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0f85e-36bf-460c-9938-1af3b8e186aa None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:57.182575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 463/948] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Jun 17 08:33:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:33:57.254271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0f85e-36bf-460c-9938-1af3b8e186aa None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:57.303246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fc309-9af9-4f32-9fae-61babb1503f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:57.304365 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc309-9af9-4f32-9fae-61babb1503f9 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:57.304929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc309-9af9-4f32-9fae-61babb1503f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:57.305480 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc309-9af9-4f32-9fae-61babb1503f9 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:57.306460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fc309-9af9-4f32-9fae-61babb1503f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:57.308182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fc309-9af9-4f32-9fae-61babb1503f9 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:57.318390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 486/949] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Jun 17 08:33:57 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:33:58.390286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153810-d844-4a59-9110-3552a279ff0c None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:58.390835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153810-d844-4a59-9110-3552a279ff0c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:58.390835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153810-d844-4a59-9110-3552a279ff0c None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:58.392507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 464/950] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:58.398242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5192-fdef-46fe-82a3-337c1ddd15e7 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:58.398719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5192-fdef-46fe-82a3-337c1ddd15e7 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:58.398821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5192-fdef-46fe-82a3-337c1ddd15e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:58.406799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:58.418100 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-37be5192-fdef-46fe-82a3-337c1ddd15e7 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:58.419892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-37be5192-fdef-46fe-82a3-337c1ddd15e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:58.496078 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 487/951] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:58.521002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153810-d844-4a59-9110-3552a279ff0c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:58.604284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b9ec-2dce-46a2-b867-afb3d523b40c None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:58.604730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b9ec-2dce-46a2-b867-afb3d523b40c None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:58.605249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b9ec-2dce-46a2-b867-afb3d523b40c None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:58.607997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 488/952] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:58.613194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e4fe4-ce6f-4a3c-8a9e-3d1b56d8aff0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:58.613724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e4fe4-ce6f-4a3c-8a9e-3d1b56d8aff0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:58.614212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e4fe4-ce6f-4a3c-8a9e-3d1b56d8aff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:58.634285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1a4e4fe4-ce6f-4a3c-8a9e-3d1b56d8aff0 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:58.636631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1a4e4fe4-ce6f-4a3c-8a9e-3d1b56d8aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:58.640241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153810-d844-4a59-9110-3552a279ff0c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:58.672651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:58.679433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f28b0-5dbf-440b-a109-6f5644dc0a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:58.680174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f28b0-5dbf-440b-a109-6f5644dc0a01 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:58.680524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f28b0-5dbf-440b-a109-6f5644dc0a01 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:58.680863 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f28b0-5dbf-440b-a109-6f5644dc0a01 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:58.681758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f28b0-5dbf-440b-a109-6f5644dc0a01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:58.683424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f28b0-5dbf-440b-a109-6f5644dc0a01 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:58.722693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 489/953] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:58.730425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.sql.core [None req-903f28b0-5dbf-440b-a109-6f5644dc0a01 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 08:33:58.730425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 08:33:58.730425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [parameters: {'user_id': 'b17b61784e484fc18d273dd90be62074', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 08:33:58.730425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87052) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-903f28b0-5dbf-440b-a109-6f5644dc0a01 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application result.read() Jun 17 08:33:58.739225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:33:58.746674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application yield resource Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application next(self.gen) Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise self.value Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application session.commit() Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 08:33:58.748162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self.session.flush() Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application compat.raise_( Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 08:33:58.749153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 08:33:58.750060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application conn.query(q) Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application result.read() Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 08:33:58.750925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b17b61784e484fc18d273dd90be62074', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:58.761320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 17 08:33:58.763041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 17 08:33:58.769442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 17 08:33:58.769442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 17 08:33:58.769442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 08:33:58.769442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 08:33:58.769442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 08:33:58.769442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:58.769442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 465/954] 10.222.0.78 () {60 vars in 1131 bytes} [Fri Jun 17 08:33:58 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:58.769926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e4fe4-ce6f-4a3c-8a9e-3d1b56d8aff0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:58.770016 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f28b0-5dbf-440b-a109-6f5644dc0a01 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:58.832083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:58.862048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f28b0-5dbf-440b-a109-6f5644dc0a01 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:58.885548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e4fe4-ce6f-4a3c-8a9e-3d1b56d8aff0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:58.900082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847cf37-c3eb-4fec-9544-82d8545533a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:58.900594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847cf37-c3eb-4fec-9544-82d8545533a4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:58.900955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847cf37-c3eb-4fec-9544-82d8545533a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:58.901326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847cf37-c3eb-4fec-9544-82d8545533a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:58.913233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847cf37-c3eb-4fec-9544-82d8545533a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-6847cf37-c3eb-4fec-9544-82d8545533a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:33:58.921998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:58.923918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:58.926118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 466/955] 10.222.0.78 () {56 vars in 1120 bytes} [Fri Jun 17 08:33:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:58.929150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815def37-60cd-4aa1-b880-bd9e7fd86db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:58.929150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815def37-60cd-4aa1-b880-bd9e7fd86db1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:58.929150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815def37-60cd-4aa1-b880-bd9e7fd86db1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:58.929608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815def37-60cd-4aa1-b880-bd9e7fd86db1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:58.935408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847cf37-c3eb-4fec-9544-82d8545533a4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:58.938995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815def37-60cd-4aa1-b880-bd9e7fd86db1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:58.941091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815def37-60cd-4aa1-b880-bd9e7fd86db1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-815def37-60cd-4aa1-b880-bd9e7fd86db1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:58.961256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:58.963276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:58.964671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 490/956] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:33:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:58.971388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815def37-60cd-4aa1-b880-bd9e7fd86db1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:59.000584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:59.052431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847cf37-c3eb-4fec-9544-82d8545533a4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:59.090124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266bf74-5b78-4591-a33d-8548cebdf729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:59.091074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266bf74-5b78-4591-a33d-8548cebdf729 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.091538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266bf74-5b78-4591-a33d-8548cebdf729 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.091694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815def37-60cd-4aa1-b880-bd9e7fd86db1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:59.091954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266bf74-5b78-4591-a33d-8548cebdf729 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.092879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266bf74-5b78-4591-a33d-8548cebdf729 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:59.093287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266bf74-5b78-4591-a33d-8548cebdf729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:59.094944 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266bf74-5b78-4591-a33d-8548cebdf729 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:59.111901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 467/957] 10.222.0.78 () {56 vars in 1115 bytes} [Fri Jun 17 08:33:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:59.112916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266bf74-5b78-4591-a33d-8548cebdf729 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:59.117474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:59.129840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c439c15-eb92-4431-828c-9c4acfa11675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:59.130897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c439c15-eb92-4431-828c-9c4acfa11675 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.131066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c439c15-eb92-4431-828c-9c4acfa11675 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.131364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c439c15-eb92-4431-828c-9c4acfa11675 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.132291 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c439c15-eb92-4431-828c-9c4acfa11675 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:59.132594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c439c15-eb92-4431-828c-9c4acfa11675 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:59.134183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c439c15-eb92-4431-828c-9c4acfa11675 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:59.179997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 491/958] 10.222.0.78 () {56 vars in 1101 bytes} [Fri Jun 17 08:33:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:59.225552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266bf74-5b78-4591-a33d-8548cebdf729 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:59.242087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:59.265621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca143d5a-25c3-4a9d-9400-b098e2c70c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:59.266446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca143d5a-25c3-4a9d-9400-b098e2c70c6a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.266729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca143d5a-25c3-4a9d-9400-b098e2c70c6a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.267007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca143d5a-25c3-4a9d-9400-b098e2c70c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.279889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca143d5a-25c3-4a9d-9400-b098e2c70c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:59.281373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca143d5a-25c3-4a9d-9400-b098e2c70c6a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-ca143d5a-25c3-4a9d-9400-b098e2c70c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:33:59.300549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:59.302748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:59.304941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:33:59.304941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:33:59.304941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:33:59.304941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:59.304941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 468/959] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:59.308526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c439c15-eb92-4431-828c-9c4acfa11675 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:59.399183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24759a-e24c-46a1-891a-e359790add78 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.399835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24759a-e24c-46a1-891a-e359790add78 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.399835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24759a-e24c-46a1-891a-e359790add78 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.401228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 469/960] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:33:59.408109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1cf30-b2cb-41e2-be2f-adc8752223d9 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.408399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1cf30-b2cb-41e2-be2f-adc8752223d9 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.409327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1cf30-b2cb-41e2-be2f-adc8752223d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.428034 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c439c15-eb92-4431-828c-9c4acfa11675 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:59.429499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-7cc1cf30-b2cb-41e2-be2f-adc8752223d9 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:59.431108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-7cc1cf30-b2cb-41e2-be2f-adc8752223d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:59.484428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26add43-0a7f-4d2d-aec0-66fbe9f4d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:59.485101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26add43-0a7f-4d2d-aec0-66fbe9f4d30c None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.485455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26add43-0a7f-4d2d-aec0-66fbe9f4d30c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.485724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26add43-0a7f-4d2d-aec0-66fbe9f4d30c None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.486443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26add43-0a7f-4d2d-aec0-66fbe9f4d30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:59.486751 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26add43-0a7f-4d2d-aec0-66fbe9f4d30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:59.490525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26add43-0a7f-4d2d-aec0-66fbe9f4d30c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:59.506644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 492/961] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:59.513003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26add43-0a7f-4d2d-aec0-66fbe9f4d30c None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:59.533649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 470/962] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:33:59.555438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1cf30-b2cb-41e2-be2f-adc8752223d9 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:59.568923 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:59.628177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26add43-0a7f-4d2d-aec0-66fbe9f4d30c None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:59.657925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:59.662878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41134f-adbf-456b-9c55-3144a0fcdb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:59.663733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41134f-adbf-456b-9c55-3144a0fcdb1d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.663870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1cf30-b2cb-41e2-be2f-adc8752223d9 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:59.664018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41134f-adbf-456b-9c55-3144a0fcdb1d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.664298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41134f-adbf-456b-9c55-3144a0fcdb1d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.672298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41134f-adbf-456b-9c55-3144a0fcdb1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:59.673866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41134f-adbf-456b-9c55-3144a0fcdb1d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-1c41134f-adbf-456b-9c55-3144a0fcdb1d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:33:59.688415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:59.689428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:33:59.690389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 493/963] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Jun 17 08:33:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:59.691134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9928d-2c0a-409b-8307-052e0f411a1a None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.691536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9928d-2c0a-409b-8307-052e0f411a1a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.691764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9928d-2c0a-409b-8307-052e0f411a1a None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.692915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 494/964] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:33:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:33:59.695514 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9928d-2c0a-409b-8307-052e0f411a1a None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:59.700676 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359bcb9-d029-4d6f-81af-f9d18572d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:59.701479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359bcb9-d029-4d6f-81af-f9d18572d6af None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.701764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359bcb9-d029-4d6f-81af-f9d18572d6af None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.702037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359bcb9-d029-4d6f-81af-f9d18572d6af None admin] PATH_INFO: `/v3/services/compute` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.702696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359bcb9-d029-4d6f-81af-f9d18572d6af None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:59.704090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359bcb9-d029-4d6f-81af-f9d18572d6af None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-6359bcb9-d029-4d6f-81af-f9d18572d6af None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:33:59.716664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:33:59.717917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:33:59.719078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 471/965] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:33:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:33:59.719964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8a8f-fa66-4322-bb33-44c1b8e30958 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.719964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8a8f-fa66-4322-bb33-44c1b8e30958 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.719964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8a8f-fa66-4322-bb33-44c1b8e30958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.738229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d26c8a8f-fa66-4322-bb33-44c1b8e30958 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:33:59.739452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d26c8a8f-fa66-4322-bb33-44c1b8e30958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:33:59.806676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9928d-2c0a-409b-8307-052e0f411a1a None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:59.808369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:59.809967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 472/966] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:33:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:33:59.810908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c8a8f-fa66-4322-bb33-44c1b8e30958 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:59.843154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a972ec-9cf6-49da-a990-4a1bbc672f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:59.843901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a972ec-9cf6-49da-a990-4a1bbc672f5a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.844187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a972ec-9cf6-49da-a990-4a1bbc672f5a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.844466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a972ec-9cf6-49da-a990-4a1bbc672f5a None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.845305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a972ec-9cf6-49da-a990-4a1bbc672f5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:59.845615 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a972ec-9cf6-49da-a990-4a1bbc672f5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:59.847047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a972ec-9cf6-49da-a990-4a1bbc672f5a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:59.869208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 495/967] 10.222.0.78 () {56 vars in 1149 bytes} [Fri Jun 17 08:33:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:33:59.870003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a972ec-9cf6-49da-a990-4a1bbc672f5a None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:59.907557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:33:59.917222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c8a8f-fa66-4322-bb33-44c1b8e30958 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:33:59.953097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91783f-c06a-40ae-b8ca-6a60cce41b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:33:59.953679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91783f-c06a-40ae-b8ca-6a60cce41b75 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:33:59.953959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91783f-c06a-40ae-b8ca-6a60cce41b75 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:33:59.954231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91783f-c06a-40ae-b8ca-6a60cce41b75 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:33:59.954925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91783f-c06a-40ae-b8ca-6a60cce41b75 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:33:59.955228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91783f-c06a-40ae-b8ca-6a60cce41b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:33:59.956629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91783f-c06a-40ae-b8ca-6a60cce41b75 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:33:59.961463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 473/968] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:33:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:33:59.962234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91783f-c06a-40ae-b8ca-6a60cce41b75 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:33:59.977187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a972ec-9cf6-49da-a990-4a1bbc672f5a None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:00.011821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e895762-2c50-4ca0-a5af-1f67aa9362e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:00.013258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895762-2c50-4ca0-a5af-1f67aa9362e1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:00.013541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895762-2c50-4ca0-a5af-1f67aa9362e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:00.013820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e895762-2c50-4ca0-a5af-1f67aa9362e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:00.014475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e895762-2c50-4ca0-a5af-1f67aa9362e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:00.015885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e895762-2c50-4ca0-a5af-1f67aa9362e1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-8e895762-2c50-4ca0-a5af-1f67aa9362e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:00.028396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:00.029595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:00.030466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 496/969] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:33:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:00.031282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e895762-2c50-4ca0-a5af-1f67aa9362e1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:00.056510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:00.065025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91783f-c06a-40ae-b8ca-6a60cce41b75 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:00.098982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25e264-76b2-4697-a321-e1188d34e7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:00.099684 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e264-76b2-4697-a321-e1188d34e7b4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:00.099969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e264-76b2-4697-a321-e1188d34e7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:00.100241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e264-76b2-4697-a321-e1188d34e7b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:00.124376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:00.131124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e895762-2c50-4ca0-a5af-1f67aa9362e1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:00.164820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324518-babd-4175-99e4-b3339ff59f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:00.165489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324518-babd-4175-99e4-b3339ff59f71 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:00.165777 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324518-babd-4175-99e4-b3339ff59f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:00.166057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324518-babd-4175-99e4-b3339ff59f71 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:00.166768 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324518-babd-4175-99e4-b3339ff59f71 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:00.167075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324518-babd-4175-99e4-b3339ff59f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:00.168496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324518-babd-4175-99e4-b3339ff59f71 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:00.168624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25e264-76b2-4697-a321-e1188d34e7b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:00.170061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25e264-76b2-4697-a321-e1188d34e7b4 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:00.173374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 497/970] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:34:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:00.174166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324518-babd-4175-99e4-b3339ff59f71 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:00.280390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:00.294871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324518-babd-4175-99e4-b3339ff59f71 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:00.295669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 474/971] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:33:59 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:34:00.301784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25e264-76b2-4697-a321-e1188d34e7b4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:00.333285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39697275-6b31-4553-9b04-2d69bd0dd023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:00.333969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39697275-6b31-4553-9b04-2d69bd0dd023 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:00.334259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39697275-6b31-4553-9b04-2d69bd0dd023 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:00.334542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39697275-6b31-4553-9b04-2d69bd0dd023 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:00.335256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39697275-6b31-4553-9b04-2d69bd0dd023 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:00.335601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39697275-6b31-4553-9b04-2d69bd0dd023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:00.336983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39697275-6b31-4553-9b04-2d69bd0dd023 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:00.348065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 498/972] 10.222.0.78 () {56 vars in 1122 bytes} [Fri Jun 17 08:34:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:00.349283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39697275-6b31-4553-9b04-2d69bd0dd023 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:00.370560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:00.420767 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25e264-76b2-4697-a321-e1188d34e7b4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:00.457720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39697275-6b31-4553-9b04-2d69bd0dd023 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:00.459870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1b38c-1045-4263-8265-00f96acd7c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:00.460923 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b38c-1045-4263-8265-00f96acd7c79 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:00.461055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b38c-1045-4263-8265-00f96acd7c79 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:00.461249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b38c-1045-4263-8265-00f96acd7c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:00.473237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1b38c-1045-4263-8265-00f96acd7c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:00.474783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1b38c-1045-4263-8265-00f96acd7c79 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-dae1b38c-1045-4263-8265-00f96acd7c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:34:00.494582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:00.495672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:00.496551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:34:00.496551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:34:00.496551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:00.496551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:00.496551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 475/973] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:34:00.500962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472bdd0-ccd2-44c5-b8e0-2be539d41877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:00.501889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472bdd0-ccd2-44c5-b8e0-2be539d41877 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:00.502178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472bdd0-ccd2-44c5-b8e0-2be539d41877 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:00.502458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472bdd0-ccd2-44c5-b8e0-2be539d41877 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:00.502553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1b38c-1045-4263-8265-00f96acd7c79 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:00.503174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472bdd0-ccd2-44c5-b8e0-2be539d41877 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:00.503514 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472bdd0-ccd2-44c5-b8e0-2be539d41877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:00.504891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472bdd0-ccd2-44c5-b8e0-2be539d41877 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:00.516836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 499/974] 10.222.0.78 () {56 vars in 1122 bytes} [Fri Jun 17 08:34:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:00.517251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472bdd0-ccd2-44c5-b8e0-2be539d41877 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:00.536270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:00.618073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1b38c-1045-4263-8265-00f96acd7c79 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:00.621540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472bdd0-ccd2-44c5-b8e0-2be539d41877 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:00.625803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:00.654262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0505768-8d8f-4ae6-bd6e-aeaed05bec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:00.655028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0505768-8d8f-4ae6-bd6e-aeaed05bec3e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:00.655329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0505768-8d8f-4ae6-bd6e-aeaed05bec3e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:00.655612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0505768-8d8f-4ae6-bd6e-aeaed05bec3e None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:00.656329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0505768-8d8f-4ae6-bd6e-aeaed05bec3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:00.656916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0505768-8d8f-4ae6-bd6e-aeaed05bec3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:00.657995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0505768-8d8f-4ae6-bd6e-aeaed05bec3e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:00.662335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef29429-d49d-403f-a261-16e15425ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:00.662995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef29429-d49d-403f-a261-16e15425ed7f None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:00.663275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef29429-d49d-403f-a261-16e15425ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:00.663574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef29429-d49d-403f-a261-16e15425ed7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:00.664313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef29429-d49d-403f-a261-16e15425ed7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:00.666217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef29429-d49d-403f-a261-16e15425ed7f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:00.670639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 476/975] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:00.676383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0505768-8d8f-4ae6-bd6e-aeaed05bec3e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:00.738971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 500/976] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Jun 17 08:34:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:34:00.792788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0505768-8d8f-4ae6-bd6e-aeaed05bec3e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:00.838338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc970c8-5030-4af1-8a4e-318362e26f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:00.839152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc970c8-5030-4af1-8a4e-318362e26f91 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:00.839463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc970c8-5030-4af1-8a4e-318362e26f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:00.839740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc970c8-5030-4af1-8a4e-318362e26f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:00.847744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc970c8-5030-4af1-8a4e-318362e26f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:00.849223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc970c8-5030-4af1-8a4e-318362e26f91 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-abc970c8-5030-4af1-8a4e-318362e26f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:34:00.864706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:00.865672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:00.866551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:34:00.866551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:34:00.866551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:34:00.866551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:34:00.866551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:34:00.866551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:34:00.866551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:34:00.866551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:00.866551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 477/977] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:00.874023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef29429-d49d-403f-a261-16e15425ed7f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:00.957250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:00.987813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef29429-d49d-403f-a261-16e15425ed7f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:01.021784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d01f3e-93a5-4e28-8a1d-22a5016ba989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:01.022447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01f3e-93a5-4e28-8a1d-22a5016ba989 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:01.022734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01f3e-93a5-4e28-8a1d-22a5016ba989 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:01.023016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01f3e-93a5-4e28-8a1d-22a5016ba989 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:01.024176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d01f3e-93a5-4e28-8a1d-22a5016ba989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:01.024497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d01f3e-93a5-4e28-8a1d-22a5016ba989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:01.026178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d01f3e-93a5-4e28-8a1d-22a5016ba989 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:01.044531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 501/978] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:01.046028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc970c8-5030-4af1-8a4e-318362e26f91 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:01.071425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:01.150565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc970c8-5030-4af1-8a4e-318362e26f91 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:01.185155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03993099-c036-47e4-8bde-43e05354a33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:01.185808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03993099-c036-47e4-8bde-43e05354a33a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:01.186091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03993099-c036-47e4-8bde-43e05354a33a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:01.186367 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03993099-c036-47e4-8bde-43e05354a33a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:01.187190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03993099-c036-47e4-8bde-43e05354a33a None admin] RBAC: Adding query filter params (role.id=ce0dd8032e4943a59fd5fc51178f7aff, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=7687888c51224d8e94018f35a82fbcc4) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:01.187526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03993099-c036-47e4-8bde-43e05354a33a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:01.188955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03993099-c036-47e4-8bde-43e05354a33a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:01.195687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 478/979] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:34:01 2022] GET /identity/v3/role_assignments?user.id=7687888c51224d8e94018f35a82fbcc4&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=ce0dd8032e4943a59fd5fc51178f7aff => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:02.342935 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a233bfc-2966-4b81-bc0f-dd283992a369 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:02.343676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a233bfc-2966-4b81-bc0f-dd283992a369 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:02.343676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a233bfc-2966-4b81-bc0f-dd283992a369 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:02.344947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 502/980] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:02.350219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae99a-3251-41ee-8401-5c043a887165 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:02.350631 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae99a-3251-41ee-8401-5c043a887165 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:02.351078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ae99a-3251-41ee-8401-5c043a887165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:02.369023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-4c7ae99a-3251-41ee-8401-5c043a887165 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:02.370223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4c7ae99a-3251-41ee-8401-5c043a887165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:02.440176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 479/981] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:02.464017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a233bfc-2966-4b81-bc0f-dd283992a369 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:02.570375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a233bfc-2966-4b81-bc0f-dd283992a369 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:02.600223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:02.605711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bc80c-dbab-451f-8455-a44fc8ec3e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:02.606407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bc80c-dbab-451f-8455-a44fc8ec3e94 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:02.606764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bc80c-dbab-451f-8455-a44fc8ec3e94 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:02.607070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bc80c-dbab-451f-8455-a44fc8ec3e94 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:02.607822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bc80c-dbab-451f-8455-a44fc8ec3e94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:02.609191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bc80c-dbab-451f-8455-a44fc8ec3e94 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:02.671037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 503/982] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:34:02 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:34:02.892014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a34f8-6f0d-414d-861f-d665049de9e1 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:02.892210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a34f8-6f0d-414d-861f-d665049de9e1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:02.892491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a34f8-6f0d-414d-861f-d665049de9e1 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:02.894025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 480/983] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:02.898999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab6584-133e-4e10-9802-8ba04ea75509 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:02.899398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab6584-133e-4e10-9802-8ba04ea75509 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:02.899820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab6584-133e-4e10-9802-8ba04ea75509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:02.917321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-d0ab6584-133e-4e10-9802-8ba04ea75509 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:02.918585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d0ab6584-133e-4e10-9802-8ba04ea75509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:02.993888 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 504/984] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:03.016128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a34f8-6f0d-414d-861f-d665049de9e1 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:03.035604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:03.122545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a34f8-6f0d-414d-861f-d665049de9e1 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:03.156602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7cecb-60e8-4ac4-af10-d3f59b5d9040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:03.157334 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7cecb-60e8-4ac4-af10-d3f59b5d9040 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:03.157618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7cecb-60e8-4ac4-af10-d3f59b5d9040 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:03.157895 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7cecb-60e8-4ac4-af10-d3f59b5d9040 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:03.158546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7cecb-60e8-4ac4-af10-d3f59b5d9040 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:03.160261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7cecb-60e8-4ac4-af10-d3f59b5d9040 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-24a7cecb-60e8-4ac4-af10-d3f59b5d9040 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:03.172893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:03.173891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:03.175161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 481/985] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:34:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:03.185811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab6584-133e-4e10-9802-8ba04ea75509 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:03.286629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab6584-133e-4e10-9802-8ba04ea75509 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:03.305654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:03.326093 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f522b2-ca0d-4152-9a7f-76583dfdab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:03.327168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f522b2-ca0d-4152-9a7f-76583dfdab9c None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:03.327704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f522b2-ca0d-4152-9a7f-76583dfdab9c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:03.328177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f522b2-ca0d-4152-9a7f-76583dfdab9c None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:03.329103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f522b2-ca0d-4152-9a7f-76583dfdab9c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:03.329619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f522b2-ca0d-4152-9a7f-76583dfdab9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:03.331260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f522b2-ca0d-4152-9a7f-76583dfdab9c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:03.337661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 505/986] 10.222.0.78 () {56 vars in 1122 bytes} [Fri Jun 17 08:34:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:03.344064 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7cecb-60e8-4ac4-af10-d3f59b5d9040 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:03.374277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b34b6-c2bd-4fe0-af80-2ac01f5e9eed None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:03.374807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b34b6-c2bd-4fe0-af80-2ac01f5e9eed None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:03.374807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b34b6-c2bd-4fe0-af80-2ac01f5e9eed None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:03.379553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 506/987] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:34:03.381708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1def32-8b29-474d-9c99-e1ee6b0ca621 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:03.382005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1def32-8b29-474d-9c99-e1ee6b0ca621 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:03.382294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1def32-8b29-474d-9c99-e1ee6b0ca621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:03.400488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1c1def32-8b29-474d-9c99-e1ee6b0ca621 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:03.401797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1c1def32-8b29-474d-9c99-e1ee6b0ca621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:03.434245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:03.459484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7cecb-60e8-4ac4-af10-d3f59b5d9040 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:03.477837 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 507/988] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:03.499900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1def32-8b29-474d-9c99-e1ee6b0ca621 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:03.504154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10939c-2871-4a63-b2e7-2789b0ec69e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:03.504997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10939c-2871-4a63-b2e7-2789b0ec69e0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:03.505426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10939c-2871-4a63-b2e7-2789b0ec69e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:03.505849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10939c-2871-4a63-b2e7-2789b0ec69e0 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:03.506697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10939c-2871-4a63-b2e7-2789b0ec69e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:03.507246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10939c-2871-4a63-b2e7-2789b0ec69e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:03.508907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10939c-2871-4a63-b2e7-2789b0ec69e0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:03.515722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 482/989] 10.222.0.78 () {56 vars in 1122 bytes} [Fri Jun 17 08:34:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:03.521009 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10939c-2871-4a63-b2e7-2789b0ec69e0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:03.604721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1def32-8b29-474d-9c99-e1ee6b0ca621 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:03.620116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:03.628464 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10939c-2871-4a63-b2e7-2789b0ec69e0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:03.643161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70235e3d-9848-487f-8fda-19f88f6e7856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:03.643984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235e3d-9848-487f-8fda-19f88f6e7856 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:03.644289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235e3d-9848-487f-8fda-19f88f6e7856 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:03.644552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235e3d-9848-487f-8fda-19f88f6e7856 None admin] PATH_INFO: `/v3/services/image` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:03.645206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70235e3d-9848-487f-8fda-19f88f6e7856 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:03.646937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70235e3d-9848-487f-8fda-19f88f6e7856 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-70235e3d-9848-487f-8fda-19f88f6e7856 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:03.660399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:03.661401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:03.663208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 508/990] 10.222.0.78 () {56 vars in 1105 bytes} [Fri Jun 17 08:34:03 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:34:03.665336 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61378f5-7ab1-4c8e-bd38-b484db1037a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:03.666003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61378f5-7ab1-4c8e-bd38-b484db1037a0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:03.666349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61378f5-7ab1-4c8e-bd38-b484db1037a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:03.666635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61378f5-7ab1-4c8e-bd38-b484db1037a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:03.667455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61378f5-7ab1-4c8e-bd38-b484db1037a0 None admin] RBAC: Adding query filter params (interface=admin, service_id=7e6649c113f3418b81ab29c23867bf5f, region_id=RegionOne) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:03.667552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70235e3d-9848-487f-8fda-19f88f6e7856 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:03.667844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61378f5-7ab1-4c8e-bd38-b484db1037a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:03.669324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61378f5-7ab1-4c8e-bd38-b484db1037a0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:03.679901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 483/991] 10.222.0.78 () {56 vars in 1249 bytes} [Fri Jun 17 08:34:03 2022] GET /identity/v3/endpoints?service_id=7e6649c113f3418b81ab29c23867bf5f&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:03.680791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61378f5-7ab1-4c8e-bd38-b484db1037a0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:03.691776 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:03.777304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70235e3d-9848-487f-8fda-19f88f6e7856 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:03.789443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61378f5-7ab1-4c8e-bd38-b484db1037a0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:03.816511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a204c-a820-41f5-b94b-74b53ab2ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:03.817532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a204c-a820-41f5-b94b-74b53ab2ed3b None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:03.818004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a204c-a820-41f5-b94b-74b53ab2ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:03.818353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a204c-a820-41f5-b94b-74b53ab2ed3b None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:03.819055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a204c-a820-41f5-b94b-74b53ab2ed3b None admin] RBAC: Adding query filter params (name=image) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:03.819373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a204c-a820-41f5-b94b-74b53ab2ed3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:03.820793 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a204c-a820-41f5-b94b-74b53ab2ed3b None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:03.830975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 509/992] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:03.831140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f9ec9-1056-4658-8f3a-02e54acc5667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:03.831140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9ec9-1056-4658-8f3a-02e54acc5667 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:03.831140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9ec9-1056-4658-8f3a-02e54acc5667 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:03.831140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9ec9-1056-4658-8f3a-02e54acc5667 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:03.831564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f9ec9-1056-4658-8f3a-02e54acc5667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:03.831564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f9ec9-1056-4658-8f3a-02e54acc5667 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:03.832002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a204c-a820-41f5-b94b-74b53ab2ed3b None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:03.837879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 484/993] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Jun 17 08:34:03 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:34:03.885781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:03.949030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a204c-a820-41f5-b94b-74b53ab2ed3b None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:03.985441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8e0dd-e02c-4c36-9138-82dcf9185e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:03.986121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e0dd-e02c-4c36-9138-82dcf9185e9d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:03.986404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e0dd-e02c-4c36-9138-82dcf9185e9d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:03.986682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e0dd-e02c-4c36-9138-82dcf9185e9d None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:03.987421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8e0dd-e02c-4c36-9138-82dcf9185e9d None admin] RBAC: Adding query filter params (type=image) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:03.987731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8e0dd-e02c-4c36-9138-82dcf9185e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:03.989114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8e0dd-e02c-4c36-9138-82dcf9185e9d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:03.994209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 510/994] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:04.838759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceb78c-80eb-4e4a-bac4-14a72d8d305f None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:04.839496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceb78c-80eb-4e4a-bac4-14a72d8d305f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:04.839496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceb78c-80eb-4e4a-bac4-14a72d8d305f None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:04.841461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 485/995] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:04.846663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334129-e103-4492-b7c7-50f91da57f1f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:04.847094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334129-e103-4492-b7c7-50f91da57f1f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:04.847259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334129-e103-4492-b7c7-50f91da57f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:04.864378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-d4334129-e103-4492-b7c7-50f91da57f1f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:04.865554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d4334129-e103-4492-b7c7-50f91da57f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:04.931614 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 511/996] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:04.955718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eceb78c-80eb-4e4a-bac4-14a72d8d305f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:05.025180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:05.055340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eceb78c-80eb-4e4a-bac4-14a72d8d305f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:05.092848 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edfbb3-c4b0-4c78-b5cc-d86982372de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:05.093564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edfbb3-c4b0-4c78-b5cc-d86982372de9 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:05.093844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edfbb3-c4b0-4c78-b5cc-d86982372de9 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:05.094117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edfbb3-c4b0-4c78-b5cc-d86982372de9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:05.094767 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edfbb3-c4b0-4c78-b5cc-d86982372de9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:05.096150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edfbb3-c4b0-4c78-b5cc-d86982372de9 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-73edfbb3-c4b0-4c78-b5cc-d86982372de9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:05.108620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:05.109665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:34:05.110509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:05.114628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 486/997] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:34:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:05.116031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4334129-e103-4492-b7c7-50f91da57f1f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:05.149726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:05.215158 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4334129-e103-4492-b7c7-50f91da57f1f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:05.248961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34324c04-2b71-4cd3-8c48-b9fe4a30b300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:05.249615 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34324c04-2b71-4cd3-8c48-b9fe4a30b300 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:05.249897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34324c04-2b71-4cd3-8c48-b9fe4a30b300 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:05.250174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34324c04-2b71-4cd3-8c48-b9fe4a30b300 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:05.250867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34324c04-2b71-4cd3-8c48-b9fe4a30b300 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:05.251169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34324c04-2b71-4cd3-8c48-b9fe4a30b300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:05.252561 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34324c04-2b71-4cd3-8c48-b9fe4a30b300 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:05.257479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 512/998] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:34:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:05.263087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edfbb3-c4b0-4c78-b5cc-d86982372de9 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:05.362472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edfbb3-c4b0-4c78-b5cc-d86982372de9 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:05.396636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c02d1f-a82a-45f2-a432-159704a5d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:05.397292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c02d1f-a82a-45f2-a432-159704a5d7ae None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:05.397572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c02d1f-a82a-45f2-a432-159704a5d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:05.397845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c02d1f-a82a-45f2-a432-159704a5d7ae None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:05.398533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c02d1f-a82a-45f2-a432-159704a5d7ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:05.398837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c02d1f-a82a-45f2-a432-159704a5d7ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:05.400271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c02d1f-a82a-45f2-a432-159704a5d7ae None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:05.402256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:05.406103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 487/999] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:34:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:05.411866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34324c04-2b71-4cd3-8c48-b9fe4a30b300 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:05.520228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:05.524388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34324c04-2b71-4cd3-8c48-b9fe4a30b300 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:05.559728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051fe93-b26a-4c54-aab4-619cdd2510c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:05.560636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051fe93-b26a-4c54-aab4-619cdd2510c2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:05.560921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051fe93-b26a-4c54-aab4-619cdd2510c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:05.561196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051fe93-b26a-4c54-aab4-619cdd2510c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:05.561988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051fe93-b26a-4c54-aab4-619cdd2510c2 None admin] RBAC: Adding query filter params (interface=public, service_id=866e214d9b44429ca6610e3c36792437, region_id=RegionOne) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:05.562295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051fe93-b26a-4c54-aab4-619cdd2510c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:05.563688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051fe93-b26a-4c54-aab4-619cdd2510c2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:05.573664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 513/1000] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Jun 17 08:34:05 2022] GET /identity/v3/endpoints?service_id=866e214d9b44429ca6610e3c36792437&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:05.575619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c02d1f-a82a-45f2-a432-159704a5d7ae None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:05.677121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c02d1f-a82a-45f2-a432-159704a5d7ae None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:05.711522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03ba9-bfa6-4c23-9e05-fbb99be9b4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:05.712192 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03ba9-bfa6-4c23-9e05-fbb99be9b4d3 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:05.712469 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03ba9-bfa6-4c23-9e05-fbb99be9b4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:05.712739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03ba9-bfa6-4c23-9e05-fbb99be9b4d3 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:05.713417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03ba9-bfa6-4c23-9e05-fbb99be9b4d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:05.714767 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03ba9-bfa6-4c23-9e05-fbb99be9b4d3 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:05.727620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 488/1001] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Jun 17 08:34:05 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:34:06.005664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e7ba-0c3e-4008-ac00-92273533f783 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:06.006215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e7ba-0c3e-4008-ac00-92273533f783 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:06.006215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e7ba-0c3e-4008-ac00-92273533f783 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:06.007736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 514/1002] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:06.012818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9362-f5e6-4697-aa4d-27a65a285d9b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:06.013280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9362-f5e6-4697-aa4d-27a65a285d9b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:06.013355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9362-f5e6-4697-aa4d-27a65a285d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:06.030425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-920f9362-f5e6-4697-aa4d-27a65a285d9b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:06.031638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-920f9362-f5e6-4697-aa4d-27a65a285d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:06.096808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:06.106626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 489/1003] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:06.129885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753e7ba-0c3e-4008-ac00-92273533f783 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:06.149898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb488d-715b-4e3d-80fd-24c1460890b6 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:06.150194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb488d-715b-4e3d-80fd-24c1460890b6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:06.150481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb488d-715b-4e3d-80fd-24c1460890b6 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:06.152033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 490/1004] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:34:06.157279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6313b-8b37-4aec-9133-83e61f963308 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:06.157572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6313b-8b37-4aec-9133-83e61f963308 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:06.157855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6313b-8b37-4aec-9133-83e61f963308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:06.176119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-11e6313b-8b37-4aec-9133-83e61f963308 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:06.177433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-11e6313b-8b37-4aec-9133-83e61f963308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:06.237979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753e7ba-0c3e-4008-ac00-92273533f783 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:06.253529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 491/1005] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:06.272759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463e21b-9f59-44f7-a323-c560608a8229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:06.273493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463e21b-9f59-44f7-a323-c560608a8229 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:06.273779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463e21b-9f59-44f7-a323-c560608a8229 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:06.274059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463e21b-9f59-44f7-a323-c560608a8229 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:06.274907 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463e21b-9f59-44f7-a323-c560608a8229 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:06.275866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6313b-8b37-4aec-9133-83e61f963308 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:06.276104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463e21b-9f59-44f7-a323-c560608a8229 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-3463e21b-9f59-44f7-a323-c560608a8229 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:06.289151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:06.290155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:06.290989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 515/1006] 10.222.0.78 () {56 vars in 1126 bytes} [Fri Jun 17 08:34:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:06.296847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463e21b-9f59-44f7-a323-c560608a8229 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:06.325061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:06.389032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6313b-8b37-4aec-9133-83e61f963308 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:06.401187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463e21b-9f59-44f7-a323-c560608a8229 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:06.416420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:06.428178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe999d-492a-41fd-9197-da3f7b41e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:06.428854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe999d-492a-41fd-9197-da3f7b41e1e6 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:06.429139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe999d-492a-41fd-9197-da3f7b41e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:06.429418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe999d-492a-41fd-9197-da3f7b41e1e6 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:06.430142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe999d-492a-41fd-9197-da3f7b41e1e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:06.431540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe999d-492a-41fd-9197-da3f7b41e1e6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:06.439899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca7407-685d-4d9b-82ed-6751b8613428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:06.440820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7407-685d-4d9b-82ed-6751b8613428 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:06.441103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7407-685d-4d9b-82ed-6751b8613428 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:06.441407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7407-685d-4d9b-82ed-6751b8613428 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:06.442110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca7407-685d-4d9b-82ed-6751b8613428 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:06.442416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca7407-685d-4d9b-82ed-6751b8613428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:06.443799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca7407-685d-4d9b-82ed-6751b8613428 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:06.451324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 516/1007] 10.222.0.78 () {56 vars in 1122 bytes} [Fri Jun 17 08:34:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:06.456920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca7407-685d-4d9b-82ed-6751b8613428 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:06.545621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 492/1008] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:34:06 2022] POST /identity/v3/services => generated 242 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:34:06.550441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:06.561544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca7407-685d-4d9b-82ed-6751b8613428 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:06.607439 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533c9a4-7a38-4d10-aac3-166dbb2eb822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:06.608137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c9a4-7a38-4d10-aac3-166dbb2eb822 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:06.608424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c9a4-7a38-4d10-aac3-166dbb2eb822 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:06.608729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c9a4-7a38-4d10-aac3-166dbb2eb822 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:06.609535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533c9a4-7a38-4d10-aac3-166dbb2eb822 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:06.609849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533c9a4-7a38-4d10-aac3-166dbb2eb822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:06.611306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533c9a4-7a38-4d10-aac3-166dbb2eb822 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:06.618084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 517/1009] 10.222.0.78 () {56 vars in 1122 bytes} [Fri Jun 17 08:34:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:06.623766 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe999d-492a-41fd-9197-da3f7b41e1e6 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:06.734579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe999d-492a-41fd-9197-da3f7b41e1e6 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:06.771257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575386a-eb56-4d13-bb53-dbc86f453b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:06.771942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575386a-eb56-4d13-bb53-dbc86f453b52 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:06.772237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575386a-eb56-4d13-bb53-dbc86f453b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:06.772498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575386a-eb56-4d13-bb53-dbc86f453b52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:06.773226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575386a-eb56-4d13-bb53-dbc86f453b52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:06.774618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575386a-eb56-4d13-bb53-dbc86f453b52 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:06.848516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 493/1010] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Jun 17 08:34:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:34:07.863676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0095b-3da0-4bc9-b906-e29f202592b7 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:07.864199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0095b-3da0-4bc9-b906-e29f202592b7 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:07.864199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0095b-3da0-4bc9-b906-e29f202592b7 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:07.865843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 518/1011] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:07.870998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f363b4-895b-43c4-9420-cd485b7b2ad4 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:07.871529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f363b4-895b-43c4-9420-cd485b7b2ad4 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:07.871612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f363b4-895b-43c4-9420-cd485b7b2ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:07.889122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-e4f363b4-895b-43c4-9420-cd485b7b2ad4 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:07.890285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e4f363b4-895b-43c4-9420-cd485b7b2ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:07.931599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:07.966028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 494/1012] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:07 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:07.988566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0095b-3da0-4bc9-b906-e29f202592b7 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:08.090230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0095b-3da0-4bc9-b906-e29f202592b7 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:08.124387 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aef5b-8ca5-41ac-a8f8-5d130c3e55db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:08.125099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aef5b-8ca5-41ac-a8f8-5d130c3e55db None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:08.125383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aef5b-8ca5-41ac-a8f8-5d130c3e55db None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:08.125659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aef5b-8ca5-41ac-a8f8-5d130c3e55db None admin] PATH_INFO: `/v3/services/compute` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:08.126310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028aef5b-8ca5-41ac-a8f8-5d130c3e55db None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:08.127705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028aef5b-8ca5-41ac-a8f8-5d130c3e55db None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-028aef5b-8ca5-41ac-a8f8-5d130c3e55db None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:08.139955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:08.140971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 08:34:08.141847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:08.143432 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 519/1013] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:34:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:08.148635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f363b4-895b-43c4-9420-cd485b7b2ad4 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:08.248133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f363b4-895b-43c4-9420-cd485b7b2ad4 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:08.282022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467a374-5561-4a96-803e-55556074c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:08.282681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467a374-5561-4a96-803e-55556074c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:08.282961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467a374-5561-4a96-803e-55556074c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:08.283233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467a374-5561-4a96-803e-55556074c6c4 None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:08.283961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467a374-5561-4a96-803e-55556074c6c4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:08.284267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467a374-5561-4a96-803e-55556074c6c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:08.285632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467a374-5561-4a96-803e-55556074c6c4 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:08.295440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 495/1014] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:34:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:08.296811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aef5b-8ca5-41ac-a8f8-5d130c3e55db None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:08.313879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:08.400560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aef5b-8ca5-41ac-a8f8-5d130c3e55db None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:08.434630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98663f3e-1ef8-43fa-90ec-b6a880d85c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:08.435301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663f3e-1ef8-43fa-90ec-b6a880d85c5c None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:08.435608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663f3e-1ef8-43fa-90ec-b6a880d85c5c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:08.435891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663f3e-1ef8-43fa-90ec-b6a880d85c5c None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:08.436595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98663f3e-1ef8-43fa-90ec-b6a880d85c5c None admin] RBAC: Adding query filter params (type=compute) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:08.436904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98663f3e-1ef8-43fa-90ec-b6a880d85c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:08.438383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98663f3e-1ef8-43fa-90ec-b6a880d85c5c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:08.448859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 520/1015] 10.222.0.78 () {56 vars in 1112 bytes} [Fri Jun 17 08:34:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:08.455725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467a374-5561-4a96-803e-55556074c6c4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:08.495845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:08.564875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467a374-5561-4a96-803e-55556074c6c4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:08.598416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1380d-042d-4637-9073-fe0a0b24895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:08.599050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1380d-042d-4637-9073-fe0a0b24895e None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:08.599327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1380d-042d-4637-9073-fe0a0b24895e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:08.599629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1380d-042d-4637-9073-fe0a0b24895e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:08.600357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1380d-042d-4637-9073-fe0a0b24895e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:08.601705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1380d-042d-4637-9073-fe0a0b24895e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:08.709218 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 496/1016] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Jun 17 08:34:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:34:08.724109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489cb50-f183-4e6b-af7c-e06ee3b9d497 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:08.724422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489cb50-f183-4e6b-af7c-e06ee3b9d497 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:08.724823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489cb50-f183-4e6b-af7c-e06ee3b9d497 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:08.726528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 521/1017] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:08.732385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c43f16-1752-4d92-8de1-094037d68f2f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:08.732719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c43f16-1752-4d92-8de1-094037d68f2f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:08.732978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c43f16-1752-4d92-8de1-094037d68f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:08.751624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b5c43f16-1752-4d92-8de1-094037d68f2f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:08.752839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b5c43f16-1752-4d92-8de1-094037d68f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:08.835259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 497/1018] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:08.857722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489cb50-f183-4e6b-af7c-e06ee3b9d497 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:08.943240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:08.968162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489cb50-f183-4e6b-af7c-e06ee3b9d497 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:09.010374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43640407-6e51-4082-a2b0-f7ac0bd836c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:09.011213 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43640407-6e51-4082-a2b0-f7ac0bd836c1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:09.011530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43640407-6e51-4082-a2b0-f7ac0bd836c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:09.011811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43640407-6e51-4082-a2b0-f7ac0bd836c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:09.013323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43640407-6e51-4082-a2b0-f7ac0bd836c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:09.014777 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43640407-6e51-4082-a2b0-f7ac0bd836c1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-43640407-6e51-4082-a2b0-f7ac0bd836c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:09.026851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:09.028697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:09.030070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 522/1019] 10.222.0.78 () {56 vars in 1105 bytes} [Fri Jun 17 08:34:08 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:09.034001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4b1b-74d4-47a4-a7f0-ba91a83c13f3 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:09.034449 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4b1b-74d4-47a4-a7f0-ba91a83c13f3 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:09.034527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43640407-6e51-4082-a2b0-f7ac0bd836c1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:09.034621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c4b1b-74d4-47a4-a7f0-ba91a83c13f3 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:09.036174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 498/1020] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:09.041139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284ada0-b39e-46f6-9e63-3df23e1207f2 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:09.041426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284ada0-b39e-46f6-9e63-3df23e1207f2 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:09.041704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284ada0-b39e-46f6-9e63-3df23e1207f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:09.059980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d284ada0-b39e-46f6-9e63-3df23e1207f2 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:09.061152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d284ada0-b39e-46f6-9e63-3df23e1207f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:09.073740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:09.133481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 499/1021] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:09.143021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43640407-6e51-4082-a2b0-f7ac0bd836c1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:09.157554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284ada0-b39e-46f6-9e63-3df23e1207f2 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:09.177851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055d6b4-02e0-4613-bcd8-bb9daa346492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:09.178520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d6b4-02e0-4613-bcd8-bb9daa346492 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:09.178807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d6b4-02e0-4613-bcd8-bb9daa346492 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:09.179084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d6b4-02e0-4613-bcd8-bb9daa346492 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:09.179832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055d6b4-02e0-4613-bcd8-bb9daa346492 None admin] RBAC: Adding query filter params (name=image) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:09.180578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055d6b4-02e0-4613-bcd8-bb9daa346492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:09.181952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055d6b4-02e0-4613-bcd8-bb9daa346492 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:09.187219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 523/1022] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:09.192512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055d6b4-02e0-4613-bcd8-bb9daa346492 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:09.202057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:09.268905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284ada0-b39e-46f6-9e63-3df23e1207f2 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:09.295331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055d6b4-02e0-4613-bcd8-bb9daa346492 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:09.311179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3d649-b4d8-4a45-a205-5593845ba8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:09.312277 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3d649-b4d8-4a45-a205-5593845ba8f9 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:09.312557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3d649-b4d8-4a45-a205-5593845ba8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:09.312990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3d649-b4d8-4a45-a205-5593845ba8f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:09.314476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3d649-b4d8-4a45-a205-5593845ba8f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:09.315953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3d649-b4d8-4a45-a205-5593845ba8f9 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:09.319391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 500/1023] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:09.325257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3d649-b4d8-4a45-a205-5593845ba8f9 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:09.331721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e8a0-3a2d-4557-8fd0-f7db76158971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:09.332388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e8a0-3a2d-4557-8fd0-f7db76158971 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:09.332671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e8a0-3a2d-4557-8fd0-f7db76158971 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:09.332947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96e8a0-3a2d-4557-8fd0-f7db76158971 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:09.333650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e8a0-3a2d-4557-8fd0-f7db76158971 None admin] RBAC: Adding query filter params (type=image) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:09.333960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e8a0-3a2d-4557-8fd0-f7db76158971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:09.335330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96e8a0-3a2d-4557-8fd0-f7db76158971 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:09.340980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 524/1024] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:09.345065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:09.346984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e8a0-3a2d-4557-8fd0-f7db76158971 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:09.417909 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:09.439136 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3d649-b4d8-4a45-a205-5593845ba8f9 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:09.455146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96e8a0-3a2d-4557-8fd0-f7db76158971 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:09.478279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911a38f-45ea-4bca-9f84-49e8be4e315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:09.479287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911a38f-45ea-4bca-9f84-49e8be4e315a None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:09.479836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911a38f-45ea-4bca-9f84-49e8be4e315a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:09.480269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911a38f-45ea-4bca-9f84-49e8be4e315a None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:09.481033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911a38f-45ea-4bca-9f84-49e8be4e315a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:09.482680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911a38f-45ea-4bca-9f84-49e8be4e315a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:09.490275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82230e7c-fc0e-45cd-bfd2-e4da78c5aa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:09.490933 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82230e7c-fc0e-45cd-bfd2-e4da78c5aa1e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:09.491704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82230e7c-fc0e-45cd-bfd2-e4da78c5aa1e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:09.491990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82230e7c-fc0e-45cd-bfd2-e4da78c5aa1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:09.493194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82230e7c-fc0e-45cd-bfd2-e4da78c5aa1e None admin] RBAC: Adding query filter params (interface=public, service_id=45c46cab6b5d400893e9cc56cc55cb34, region_id=RegionOne) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:09.493518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82230e7c-fc0e-45cd-bfd2-e4da78c5aa1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:09.495178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82230e7c-fc0e-45cd-bfd2-e4da78c5aa1e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:09.501470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 525/1025] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Jun 17 08:34:09 2022] GET /identity/v3/endpoints?service_id=45c46cab6b5d400893e9cc56cc55cb34&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:09.506952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82230e7c-fc0e-45cd-bfd2-e4da78c5aa1e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:09.579741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 501/1026] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:34:09 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:34:09.631900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82230e7c-fc0e-45cd-bfd2-e4da78c5aa1e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:09.670940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232d29c-2aa4-4388-9090-e8936b4e6e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:09.671678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232d29c-2aa4-4388-9090-e8936b4e6e41 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:09.671961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232d29c-2aa4-4388-9090-e8936b4e6e41 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:09.672238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232d29c-2aa4-4388-9090-e8936b4e6e41 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:09.672938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232d29c-2aa4-4388-9090-e8936b4e6e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:09.674343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232d29c-2aa4-4388-9090-e8936b4e6e41 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:09.675667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:09.688449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 526/1027] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Jun 17 08:34:09 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:34:10.969601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a28f-4275-4ce5-af80-1ce225a1547f None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:10.970130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a28f-4275-4ce5-af80-1ce225a1547f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:10.970130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a28f-4275-4ce5-af80-1ce225a1547f None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:10.971672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 502/1028] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:10.976549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aac0c-7b27-45ca-8c78-2e22ca63210e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:10.976948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aac0c-7b27-45ca-8c78-2e22ca63210e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:10.977109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aac0c-7b27-45ca-8c78-2e22ca63210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:10.994266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b76aac0c-7b27-45ca-8c78-2e22ca63210e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:10.995463 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b76aac0c-7b27-45ca-8c78-2e22ca63210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:11.062588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 527/1029] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:11.086063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a28f-4275-4ce5-af80-1ce225a1547f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:11.151660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:11.186995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a28f-4275-4ce5-af80-1ce225a1547f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:11.221225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522501d-1ade-4d2f-bcc8-77dfc40f338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:11.221951 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522501d-1ade-4d2f-bcc8-77dfc40f338a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:11.222230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522501d-1ade-4d2f-bcc8-77dfc40f338a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:11.222505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522501d-1ade-4d2f-bcc8-77dfc40f338a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:11.233783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522501d-1ade-4d2f-bcc8-77dfc40f338a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-b522501d-1ade-4d2f-bcc8-77dfc40f338a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:34:11.241845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:11.242759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:34:11.243997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:11.245055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 503/1030] 10.222.0.78 () {56 vars in 1120 bytes} [Fri Jun 17 08:34:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:11.249531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aac0c-7b27-45ca-8c78-2e22ca63210e None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:11.348343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aac0c-7b27-45ca-8c78-2e22ca63210e None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:11.375526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:11.383784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f36e7-0698-4604-963f-b140d2e35add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:11.384452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f36e7-0698-4604-963f-b140d2e35add None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:11.384732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f36e7-0698-4604-963f-b140d2e35add None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:11.385006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f36e7-0698-4604-963f-b140d2e35add None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:11.385747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f36e7-0698-4604-963f-b140d2e35add None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:11.386051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f36e7-0698-4604-963f-b140d2e35add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:11.387725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f36e7-0698-4604-963f-b140d2e35add None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:11.400812 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 528/1031] 10.222.0.78 () {56 vars in 1115 bytes} [Fri Jun 17 08:34:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:11.402233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522501d-1ade-4d2f-bcc8-77dfc40f338a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:11.513810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522501d-1ade-4d2f-bcc8-77dfc40f338a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:11.539445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:11.549004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb52ec-d77d-4ca8-a28a-0c4349deb67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:11.549797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb52ec-d77d-4ca8-a28a-0c4349deb67d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:11.551127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb52ec-d77d-4ca8-a28a-0c4349deb67d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:11.551127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb52ec-d77d-4ca8-a28a-0c4349deb67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:11.561054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb52ec-d77d-4ca8-a28a-0c4349deb67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:11.562494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb52ec-d77d-4ca8-a28a-0c4349deb67d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-dbfb52ec-d77d-4ca8-a28a-0c4349deb67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:34:11.580720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:11.581682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:11.582598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:34:11.582598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:34:11.582598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:11.582598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:11.582598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 504/1032] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:11.588629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f36e7-0698-4604-963f-b140d2e35add None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:11.692394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f36e7-0698-4604-963f-b140d2e35add None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:11.729712 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a9516-db78-40e9-ac33-473f7281d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:11.730379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a9516-db78-40e9-ac33-473f7281d047 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:11.730702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a9516-db78-40e9-ac33-473f7281d047 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:11.731222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a9516-db78-40e9-ac33-473f7281d047 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:11.732612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a9516-db78-40e9-ac33-473f7281d047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:11.732922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a9516-db78-40e9-ac33-473f7281d047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:11.734296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a9516-db78-40e9-ac33-473f7281d047 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:11.751402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 529/1033] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:11.753784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb52ec-d77d-4ca8-a28a-0c4349deb67d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:11.768279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0277f-d3d0-47ab-9277-58ccbe371b04 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:11.768482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0277f-d3d0-47ab-9277-58ccbe371b04 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:11.768759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0277f-d3d0-47ab-9277-58ccbe371b04 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:11.770174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 530/1034] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:34:11.776011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c6c5-6864-4163-9788-bfa0bd0fd774 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:11.776327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c6c5-6864-4163-9788-bfa0bd0fd774 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:11.776586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c6c5-6864-4163-9788-bfa0bd0fd774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:11.794935 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-0586c6c5-6864-4163-9788-bfa0bd0fd774 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:11.796833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0586c6c5-6864-4163-9788-bfa0bd0fd774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:11.844247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:11.863087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb52ec-d77d-4ca8-a28a-0c4349deb67d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:11.867452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 531/1035] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:11.867452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066d7d-8123-4d92-919c-c97ec347354a None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:11.867452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066d7d-8123-4d92-919c-c97ec347354a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:11.867452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066d7d-8123-4d92-919c-c97ec347354a None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:11.868191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 532/1036] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:11.873386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51e6b5-3f06-4978-8dd0-b79dca9b3f44 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:11.873729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51e6b5-3f06-4978-8dd0-b79dca9b3f44 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:11.874020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51e6b5-3f06-4978-8dd0-b79dca9b3f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:11.891541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3c51e6b5-3f06-4978-8dd0-b79dca9b3f44 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:11.892728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3c51e6b5-3f06-4978-8dd0-b79dca9b3f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:11.900694 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e68332-adbd-4312-96d2-0e94363838a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:11.901483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e68332-adbd-4312-96d2-0e94363838a1 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:11.901768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e68332-adbd-4312-96d2-0e94363838a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:11.902050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e68332-adbd-4312-96d2-0e94363838a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:11.910260 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e68332-adbd-4312-96d2-0e94363838a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:11.911745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e68332-adbd-4312-96d2-0e94363838a1 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-b7e68332-adbd-4312-96d2-0e94363838a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:34:11.926337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:11.927316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 505/1037] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Jun 17 08:34:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:11.928333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e68332-adbd-4312-96d2-0e94363838a1 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:11.964420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 533/1038] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:11.965832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51e6b5-3f06-4978-8dd0-b79dca9b3f44 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:11.969390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:12.033066 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e68332-adbd-4312-96d2-0e94363838a1 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:12.067372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfd5e7-cdea-4c00-8aa9-9b1db661e0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:12.068187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd5e7-cdea-4c00-8aa9-9b1db661e0a8 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:12.068469 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd5e7-cdea-4c00-8aa9-9b1db661e0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:12.068755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd5e7-cdea-4c00-8aa9-9b1db661e0a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:12.069929 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfd5e7-cdea-4c00-8aa9-9b1db661e0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:12.071389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfd5e7-cdea-4c00-8aa9-9b1db661e0a8 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:12.071552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51e6b5-3f06-4978-8dd0-b79dca9b3f44 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:12.073039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 506/1039] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:12.074106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfd5e7-cdea-4c00-8aa9-9b1db661e0a8 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:12.084418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:12.109112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6bcd-801a-44f8-9c0b-e93ddf8b4166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:12.109781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6bcd-801a-44f8-9c0b-e93ddf8b4166 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:12.110074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6bcd-801a-44f8-9c0b-e93ddf8b4166 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:12.110352 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6bcd-801a-44f8-9c0b-e93ddf8b4166 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:12.111188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe6bcd-801a-44f8-9c0b-e93ddf8b4166 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:12.111527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe6bcd-801a-44f8-9c0b-e93ddf8b4166 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:12.112976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe6bcd-801a-44f8-9c0b-e93ddf8b4166 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:12.130839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 534/1040] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Jun 17 08:34:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:12.131751 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6bcd-801a-44f8-9c0b-e93ddf8b4166 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:12.179914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfd5e7-cdea-4c00-8aa9-9b1db661e0a8 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:12.188277 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:12.215745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871fa9f-f471-4f79-a61e-8482b1dd9ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:12.216544 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871fa9f-f471-4f79-a61e-8482b1dd9ce2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:12.216824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871fa9f-f471-4f79-a61e-8482b1dd9ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:12.217097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871fa9f-f471-4f79-a61e-8482b1dd9ce2 None admin] PATH_INFO: `/v3/services/image` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:12.217904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871fa9f-f471-4f79-a61e-8482b1dd9ce2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:12.219264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871fa9f-f471-4f79-a61e-8482b1dd9ce2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:12.230449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6bcd-801a-44f8-9c0b-e93ddf8b4166 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-5871fa9f-f471-4f79-a61e-8482b1dd9ce2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:12.231339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:12.232505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:12.233340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 507/1041] 10.222.0.78 () {56 vars in 1105 bytes} [Fri Jun 17 08:34:12 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:12.234129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871fa9f-f471-4f79-a61e-8482b1dd9ce2 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:12.267389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac16e6a-83be-4be7-929d-2934889332d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:12.268054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16e6a-83be-4be7-929d-2934889332d4 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:12.268337 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16e6a-83be-4be7-929d-2934889332d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:12.268611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16e6a-83be-4be7-929d-2934889332d4 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:12.269313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac16e6a-83be-4be7-929d-2934889332d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:12.270732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac16e6a-83be-4be7-929d-2934889332d4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:12.334117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871fa9f-f471-4f79-a61e-8482b1dd9ce2 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:12.356271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 535/1042] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:34:12 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:34:12.357512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac16e6a-83be-4be7-929d-2934889332d4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:12.372259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97dbfd-97a4-4bc6-82c8-faf57ccc4b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:12.373309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97dbfd-97a4-4bc6-82c8-faf57ccc4b84 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:12.373600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97dbfd-97a4-4bc6-82c8-faf57ccc4b84 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:12.373887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97dbfd-97a4-4bc6-82c8-faf57ccc4b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:12.387836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:12.423463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:12.459066 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97dbfd-97a4-4bc6-82c8-faf57ccc4b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:12.460609 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97dbfd-97a4-4bc6-82c8-faf57ccc4b84 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:12.482518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac16e6a-83be-4be7-929d-2934889332d4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:12.523631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08905170-f655-4d23-aaf0-7ace3471862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:12.524311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08905170-f655-4d23-aaf0-7ace3471862f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:12.525264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08905170-f655-4d23-aaf0-7ace3471862f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:12.525552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08905170-f655-4d23-aaf0-7ace3471862f None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:12.526282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08905170-f655-4d23-aaf0-7ace3471862f None admin] RBAC: Adding query filter params (name=image) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:12.526592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08905170-f655-4d23-aaf0-7ace3471862f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:12.528922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08905170-f655-4d23-aaf0-7ace3471862f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:12.537029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 536/1043] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:12.541652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08905170-f655-4d23-aaf0-7ace3471862f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:12.583615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 508/1044] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:34:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:34:12.589819 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97dbfd-97a4-4bc6-82c8-faf57ccc4b84 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:12.646761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:12.660589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08905170-f655-4d23-aaf0-7ace3471862f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:12.666787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:12.698189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4da9d-058f-4ed2-b1ec-c3094b5c068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:12.698402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97dbfd-97a4-4bc6-82c8-faf57ccc4b84 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:12.698858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4da9d-058f-4ed2-b1ec-c3094b5c068a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:12.699140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4da9d-058f-4ed2-b1ec-c3094b5c068a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:12.701123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4da9d-058f-4ed2-b1ec-c3094b5c068a None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:12.701926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4da9d-058f-4ed2-b1ec-c3094b5c068a None admin] RBAC: Adding query filter params (type=image) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:12.702239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4da9d-058f-4ed2-b1ec-c3094b5c068a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:12.703629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4da9d-058f-4ed2-b1ec-c3094b5c068a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:12.713925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 537/1045] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:12.716561 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4da9d-058f-4ed2-b1ec-c3094b5c068a None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:12.741546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d8b5-56b0-4d65-a1bf-02b1ffc43572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:12.742340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d8b5-56b0-4d65-a1bf-02b1ffc43572 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:12.742622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d8b5-56b0-4d65-a1bf-02b1ffc43572 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:12.742900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d8b5-56b0-4d65-a1bf-02b1ffc43572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:12.754774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805d8b5-56b0-4d65-a1bf-02b1ffc43572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:12.756282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805d8b5-56b0-4d65-a1bf-02b1ffc43572 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-6805d8b5-56b0-4d65-a1bf-02b1ffc43572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:34:12.774116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:12.775092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:12.781696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:34:12.781696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:34:12.781696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:12.781696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:12.781696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 509/1046] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:34:12.782001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d8b5-56b0-4d65-a1bf-02b1ffc43572 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:12.844522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4da9d-058f-4ed2-b1ec-c3094b5c068a None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:12.882995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc513b46-1219-442b-a080-4afa9fa04b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:12.883694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc513b46-1219-442b-a080-4afa9fa04b3f None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:12.883975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc513b46-1219-442b-a080-4afa9fa04b3f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:12.884250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc513b46-1219-442b-a080-4afa9fa04b3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:12.884984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc513b46-1219-442b-a080-4afa9fa04b3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:12.886361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc513b46-1219-442b-a080-4afa9fa04b3f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:12.891515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d8b5-56b0-4d65-a1bf-02b1ffc43572 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:12.915388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:12.927249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc0080-890b-4371-ac58-05a7e4dcb563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:12.927933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0080-890b-4371-ac58-05a7e4dcb563 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:12.928213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0080-890b-4371-ac58-05a7e4dcb563 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:12.928487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0080-890b-4371-ac58-05a7e4dcb563 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:12.929193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc0080-890b-4371-ac58-05a7e4dcb563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:12.929520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc0080-890b-4371-ac58-05a7e4dcb563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:12.930881 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc0080-890b-4371-ac58-05a7e4dcb563 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:12.943014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 510/1047] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:12.948411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc0080-890b-4371-ac58-05a7e4dcb563 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:12.979374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 538/1048] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Jun 17 08:34:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:34:13.061807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc0080-890b-4371-ac58-05a7e4dcb563 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:13.108624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b2aa-c694-41d6-8493-32489811932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:13.109356 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b2aa-c694-41d6-8493-32489811932c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:13.109644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b2aa-c694-41d6-8493-32489811932c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:13.109924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b2aa-c694-41d6-8493-32489811932c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:13.117714 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10b2aa-c694-41d6-8493-32489811932c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:13.119224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10b2aa-c694-41d6-8493-32489811932c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-7e10b2aa-c694-41d6-8493-32489811932c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:34:13.135337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:13.136407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:13.138343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:34:13.138343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:34:13.138343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:34:13.138343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:34:13.138343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:34:13.138343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:34:13.138343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:34:13.138343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:13.138343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 511/1049] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:34:13.143465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc513b46-1219-442b-a080-4afa9fa04b3f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:13.155919 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:13.254344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc513b46-1219-442b-a080-4afa9fa04b3f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:13.289684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067c634-8636-4cd3-8da4-d2db5809c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:13.290594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067c634-8636-4cd3-8da4-d2db5809c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:13.291029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067c634-8636-4cd3-8da4-d2db5809c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:13.291486 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067c634-8636-4cd3-8da4-d2db5809c9d3 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:13.292451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067c634-8636-4cd3-8da4-d2db5809c9d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:13.292948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067c634-8636-4cd3-8da4-d2db5809c9d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:13.294606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067c634-8636-4cd3-8da4-d2db5809c9d3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:13.306998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 539/1050] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:13.313891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b2aa-c694-41d6-8493-32489811932c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:13.354980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:13.416656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b2aa-c694-41d6-8493-32489811932c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:13.455936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b1aa7-46e4-4a4a-9b16-5ee58adfd817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:13.456940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1aa7-46e4-4a4a-9b16-5ee58adfd817 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:13.457434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1aa7-46e4-4a4a-9b16-5ee58adfd817 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:13.457891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1aa7-46e4-4a4a-9b16-5ee58adfd817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:13.458895 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b1aa7-46e4-4a4a-9b16-5ee58adfd817 None admin] RBAC: Adding query filter params (role.id=ce0dd8032e4943a59fd5fc51178f7aff, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=6aa3618089794b938018ff2666afebe3) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:13.459406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b1aa7-46e4-4a4a-9b16-5ee58adfd817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:13.461098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b1aa7-46e4-4a4a-9b16-5ee58adfd817 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:13.467322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 512/1051] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:34:13 2022] GET /identity/v3/role_assignments?user.id=6aa3618089794b938018ff2666afebe3&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=ce0dd8032e4943a59fd5fc51178f7aff => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:14.590627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835455fc-1c59-4b1a-9182-1f2417dc9bec None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:14.591141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835455fc-1c59-4b1a-9182-1f2417dc9bec None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:14.591218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835455fc-1c59-4b1a-9182-1f2417dc9bec None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:14.592714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 540/1052] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:14.597741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48034035-8eda-4261-b8f5-29c3fde9eb11 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:14.598154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48034035-8eda-4261-b8f5-29c3fde9eb11 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:14.598296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48034035-8eda-4261-b8f5-29c3fde9eb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:14.615921 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-48034035-8eda-4261-b8f5-29c3fde9eb11 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:14.617409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-48034035-8eda-4261-b8f5-29c3fde9eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:14.691395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 513/1053] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:14.710171 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835455fc-1c59-4b1a-9182-1f2417dc9bec None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:14.777671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:14.811849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835455fc-1c59-4b1a-9182-1f2417dc9bec None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:14.846264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4034b37-2374-481a-945f-0af07f2b0aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:14.847051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4034b37-2374-481a-945f-0af07f2b0aa8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:14.847335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4034b37-2374-481a-945f-0af07f2b0aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:14.847638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4034b37-2374-481a-945f-0af07f2b0aa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:14.857594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4034b37-2374-481a-945f-0af07f2b0aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-b4034b37-2374-481a-945f-0af07f2b0aa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:34:14.865245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:14.866184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:14.867028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:14.874797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 541/1054] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:34:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:14.874924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48034035-8eda-4261-b8f5-29c3fde9eb11 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:14.905516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:14.976716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48034035-8eda-4261-b8f5-29c3fde9eb11 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:15.014369 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edfb71-6980-44fe-8381-21aa35915392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:15.015045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edfb71-6980-44fe-8381-21aa35915392 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.015326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edfb71-6980-44fe-8381-21aa35915392 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.015625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edfb71-6980-44fe-8381-21aa35915392 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.016368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edfb71-6980-44fe-8381-21aa35915392 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:15.016784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edfb71-6980-44fe-8381-21aa35915392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:15.018170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edfb71-6980-44fe-8381-21aa35915392 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:15.031382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 514/1055] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:15.033421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4034b37-2374-481a-945f-0af07f2b0aa8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:15.142298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4034b37-2374-481a-945f-0af07f2b0aa8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:15.169945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936609-afa7-4f79-9c92-742e8df493d0 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.170333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936609-afa7-4f79-9c92-742e8df493d0 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.170673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936609-afa7-4f79-9c92-742e8df493d0 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.172173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 515/1056] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:34:15.173675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:15.177619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb0410-03d7-43b4-b2f5-67bc43ae1a97 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.177908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb0410-03d7-43b4-b2f5-67bc43ae1a97 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.178196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb0410-03d7-43b4-b2f5-67bc43ae1a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.182272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad872dc-a9b2-4c16-bd21-8af8014af494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:15.183158 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad872dc-a9b2-4c16-bd21-8af8014af494 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.183474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad872dc-a9b2-4c16-bd21-8af8014af494 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.184558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad872dc-a9b2-4c16-bd21-8af8014af494 None admin] PATH_INFO: `/v3/users/3bb948104b1f4db48adc1b52c7963e5f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.196961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-37bb0410-03d7-43b4-b2f5-67bc43ae1a97 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:15.205838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-37bb0410-03d7-43b4-b2f5-67bc43ae1a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:15.205981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad872dc-a9b2-4c16-bd21-8af8014af494 None admin] RBAC: Authorizing `identity:get_user(user_id=3bb948104b1f4db48adc1b52c7963e5f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:15.205981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad872dc-a9b2-4c16-bd21-8af8014af494 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:15.205981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 542/1057] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:15 2022] GET /identity/v3/users/3bb948104b1f4db48adc1b52c7963e5f => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:15.208469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad872dc-a9b2-4c16-bd21-8af8014af494 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:15.273772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 516/1058] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:15.296648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb0410-03d7-43b4-b2f5-67bc43ae1a97 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:15.314864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad872dc-a9b2-4c16-bd21-8af8014af494 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:15.323239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:15.352398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36ac4-779f-410e-a674-51dcd30b0695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:15.353056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36ac4-779f-410e-a674-51dcd30b0695 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.353342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36ac4-779f-410e-a674-51dcd30b0695 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.353622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36ac4-779f-410e-a674-51dcd30b0695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.406737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb0410-03d7-43b4-b2f5-67bc43ae1a97 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:15.415587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:15.429668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff36ac4-779f-410e-a674-51dcd30b0695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:15.431137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff36ac4-779f-410e-a674-51dcd30b0695 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:15.445015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430ca7-bc5a-4fab-8911-fdf363e264df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:15.445667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430ca7-bc5a-4fab-8911-fdf363e264df None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.446005 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430ca7-bc5a-4fab-8911-fdf363e264df None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.446277 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430ca7-bc5a-4fab-8911-fdf363e264df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.522310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430ca7-bc5a-4fab-8911-fdf363e264df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:15.523849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430ca7-bc5a-4fab-8911-fdf363e264df None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:15.551133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 543/1059] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:34:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 08:34:15.552178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:15.553389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36ac4-779f-410e-a674-51dcd30b0695 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:15.643755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 517/1060] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:34:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 08:34:15.645366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f45f3-c005-4cba-90c5-87d0dcec9521 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.645524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:15.645910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f45f3-c005-4cba-90c5-87d0dcec9521 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.645910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f45f3-c005-4cba-90c5-87d0dcec9521 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.647184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 518/1061] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:15.652111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f45f3-c005-4cba-90c5-87d0dcec9521 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:15.660451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36ac4-779f-410e-a674-51dcd30b0695 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:15.694916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd87004-6be2-4393-b799-3c1e90527783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:15.695796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd87004-6be2-4393-b799-3c1e90527783 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.696074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd87004-6be2-4393-b799-3c1e90527783 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.696348 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd87004-6be2-4393-b799-3c1e90527783 None admin] PATH_INFO: `/v3/projects/0fac89aeaebd47469ddb60149096d806` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.697519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd87004-6be2-4393-b799-3c1e90527783 None admin] RBAC: Authorizing `identity:get_project(project_id=0fac89aeaebd47469ddb60149096d806)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:15.698939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd87004-6be2-4393-b799-3c1e90527783 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:15.701007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 544/1062] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:34:15 2022] GET /identity/v3/projects/0fac89aeaebd47469ddb60149096d806 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:15.701007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c2ff2-c1f7-40b6-bf1f-1d300e444c48 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.701007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c2ff2-c1f7-40b6-bf1f-1d300e444c48 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.701007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c2ff2-c1f7-40b6-bf1f-1d300e444c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.717975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-c18c2ff2-c1f7-40b6-bf1f-1d300e444c48 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:15.719156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c18c2ff2-c1f7-40b6-bf1f-1d300e444c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:15.759736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f45f3-c005-4cba-90c5-87d0dcec9521 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:15.782639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:15.783928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 545/1063] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:15.784753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c2ff2-c1f7-40b6-bf1f-1d300e444c48 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:15.794151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0565e8-b2d0-4c63-ace4-b405993a43f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:15.795169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0565e8-b2d0-4c63-ace4-b405993a43f4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.795654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0565e8-b2d0-4c63-ace4-b405993a43f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.796109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0565e8-b2d0-4c63-ace4-b405993a43f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.806784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0565e8-b2d0-4c63-ace4-b405993a43f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:15.808291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0565e8-b2d0-4c63-ace4-b405993a43f4 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-9f0565e8-b2d0-4c63-ace4-b405993a43f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:34:15.827633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:15.828692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:15.829635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:34:15.829635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:34:15.829635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:15.829635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:15.830711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 519/1064] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:15.831797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0565e8-b2d0-4c63-ace4-b405993a43f4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:15.873975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:15.889440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c2ff2-c1f7-40b6-bf1f-1d300e444c48 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:15.922803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22f3c6-a059-4a0d-921b-61974cbc52e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:15.923471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22f3c6-a059-4a0d-921b-61974cbc52e4 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.923753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22f3c6-a059-4a0d-921b-61974cbc52e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.924030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22f3c6-a059-4a0d-921b-61974cbc52e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.924843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22f3c6-a059-4a0d-921b-61974cbc52e4 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=0fac89aeaebd47469ddb60149096d806, user.id=3bb948104b1f4db48adc1b52c7963e5f) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:15.925150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22f3c6-a059-4a0d-921b-61974cbc52e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:15.926558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22f3c6-a059-4a0d-921b-61974cbc52e4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:15.930495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0565e8-b2d0-4c63-ace4-b405993a43f4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:15.932159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 546/1065] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:34:15 2022] GET /identity/v3/role_assignments?user.id=3bb948104b1f4db48adc1b52c7963e5f&scope.project.id=0fac89aeaebd47469ddb60149096d806&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:15.932733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22f3c6-a059-4a0d-921b-61974cbc52e4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:15.980235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655d5e4-6d05-4942-bac7-b3346cf97dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:15.981608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655d5e4-6d05-4942-bac7-b3346cf97dd4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:15.981890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655d5e4-6d05-4942-bac7-b3346cf97dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:15.982114 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655d5e4-6d05-4942-bac7-b3346cf97dd4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:15.996050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655d5e4-6d05-4942-bac7-b3346cf97dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-a655d5e4-6d05-4942-bac7-b3346cf97dd4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:34:16.005598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:16.006657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:16.007528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 520/1066] 10.222.0.78 () {56 vars in 1120 bytes} [Fri Jun 17 08:34:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:16.013370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655d5e4-6d05-4942-bac7-b3346cf97dd4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:16.052077 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22f3c6-a059-4a0d-921b-61974cbc52e4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:16.064681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:16.089212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeb849-98a4-4fa3-8d0a-a408262fb3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:16.090381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb849-98a4-4fa3-8d0a-a408262fb3e8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:16.090679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb849-98a4-4fa3-8d0a-a408262fb3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:16.090964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb849-98a4-4fa3-8d0a-a408262fb3e8 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:16.091711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeb849-98a4-4fa3-8d0a-a408262fb3e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:16.092692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeb849-98a4-4fa3-8d0a-a408262fb3e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:16.094074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeb849-98a4-4fa3-8d0a-a408262fb3e8 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:16.108179 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 547/1067] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:16.139387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655d5e4-6d05-4942-bac7-b3346cf97dd4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:16.179320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bb4f9-2b09-49e7-a118-f764c0545926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:16.180046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb4f9-2b09-49e7-a118-f764c0545926 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:16.180331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb4f9-2b09-49e7-a118-f764c0545926 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:16.180618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb4f9-2b09-49e7-a118-f764c0545926 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:16.181381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bb4f9-2b09-49e7-a118-f764c0545926 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:16.181694 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bb4f9-2b09-49e7-a118-f764c0545926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:16.183132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bb4f9-2b09-49e7-a118-f764c0545926 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:16.198133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 521/1068] 10.222.0.78 () {56 vars in 1115 bytes} [Fri Jun 17 08:34:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:16.200969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeb849-98a4-4fa3-8d0a-a408262fb3e8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:16.213797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:16.318096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeb849-98a4-4fa3-8d0a-a408262fb3e8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:16.356208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703825e-9118-4dca-b8d7-bb0a86f4cc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:16.357299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703825e-9118-4dca-b8d7-bb0a86f4cc5f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:16.357579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703825e-9118-4dca-b8d7-bb0a86f4cc5f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:16.357848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703825e-9118-4dca-b8d7-bb0a86f4cc5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:16.368913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703825e-9118-4dca-b8d7-bb0a86f4cc5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:16.370371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703825e-9118-4dca-b8d7-bb0a86f4cc5f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-6703825e-9118-4dca-b8d7-bb0a86f4cc5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:34:16.389223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:16.390212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:16.391299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:34:16.391299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:34:16.391299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:16.391299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:16.391299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 548/1069] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:16.396946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bb4f9-2b09-49e7-a118-f764c0545926 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:16.506417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:16.510362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bb4f9-2b09-49e7-a118-f764c0545926 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:16.543608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc1566-6a3c-4d8b-8662-474dda3a53f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:16.544301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1566-6a3c-4d8b-8662-474dda3a53f8 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:16.544582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1566-6a3c-4d8b-8662-474dda3a53f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:16.544854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1566-6a3c-4d8b-8662-474dda3a53f8 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:16.545555 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc1566-6a3c-4d8b-8662-474dda3a53f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:16.545860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc1566-6a3c-4d8b-8662-474dda3a53f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:16.547204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc1566-6a3c-4d8b-8662-474dda3a53f8 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:16.558171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 522/1070] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:16.564770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703825e-9118-4dca-b8d7-bb0a86f4cc5f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:16.626855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:16.666985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703825e-9118-4dca-b8d7-bb0a86f4cc5f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:16.702481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873288f6-fb65-476b-a3fc-12c0d6d249e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:16.703265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873288f6-fb65-476b-a3fc-12c0d6d249e0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:16.703572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873288f6-fb65-476b-a3fc-12c0d6d249e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:16.703852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873288f6-fb65-476b-a3fc-12c0d6d249e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:16.711032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873288f6-fb65-476b-a3fc-12c0d6d249e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:16.712533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873288f6-fb65-476b-a3fc-12c0d6d249e0 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-873288f6-fb65-476b-a3fc-12c0d6d249e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:34:16.726857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:16.728074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:16.729329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 549/1071] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Jun 17 08:34:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:16.734465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc1566-6a3c-4d8b-8662-474dda3a53f8 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:16.833655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc1566-6a3c-4d8b-8662-474dda3a53f8 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:16.865733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0ee95-a0ca-4f51-8267-65aff93683a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:16.866401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0ee95-a0ca-4f51-8267-65aff93683a0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:16.866681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0ee95-a0ca-4f51-8267-65aff93683a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:16.866955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0ee95-a0ca-4f51-8267-65aff93683a0 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:16.867816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0ee95-a0ca-4f51-8267-65aff93683a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:16.868129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0ee95-a0ca-4f51-8267-65aff93683a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:16.869548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0ee95-a0ca-4f51-8267-65aff93683a0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:16.887704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 523/1072] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Jun 17 08:34:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:16.893544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873288f6-fb65-476b-a3fc-12c0d6d249e0 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:16.992274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873288f6-fb65-476b-a3fc-12c0d6d249e0 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:17.013131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:17.028285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801fc80-dad0-41f3-ab1b-68d3575e98fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:17.029110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fc80-dad0-41f3-ab1b-68d3575e98fe None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:17.029394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fc80-dad0-41f3-ab1b-68d3575e98fe None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:17.029673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fc80-dad0-41f3-ab1b-68d3575e98fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:17.040890 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801fc80-dad0-41f3-ab1b-68d3575e98fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:17.042375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801fc80-dad0-41f3-ab1b-68d3575e98fe None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-9801fc80-dad0-41f3-ab1b-68d3575e98fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:34:17.062711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:17.063830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:17.064771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:34:17.064771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:34:17.064771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:17.064771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:17.064771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 550/1073] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:17.069624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0ee95-a0ca-4f51-8267-65aff93683a0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:17.088671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:17.172507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0ee95-a0ca-4f51-8267-65aff93683a0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:17.207377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b2efa-eeca-4c2b-866a-5c2b763ed1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:17.208042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b2efa-eeca-4c2b-866a-5c2b763ed1ec None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:17.208327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b2efa-eeca-4c2b-866a-5c2b763ed1ec None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:17.208608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b2efa-eeca-4c2b-866a-5c2b763ed1ec None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:17.209325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b2efa-eeca-4c2b-866a-5c2b763ed1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:17.209632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b2efa-eeca-4c2b-866a-5c2b763ed1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:17.211000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b2efa-eeca-4c2b-866a-5c2b763ed1ec None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:17.222641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 524/1074] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:17.228211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801fc80-dad0-41f3-ab1b-68d3575e98fe None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:17.325319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801fc80-dad0-41f3-ab1b-68d3575e98fe None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:17.358236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b05c4f-db3c-4c88-8332-ee8a5e0b0909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:17.359021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b05c4f-db3c-4c88-8332-ee8a5e0b0909 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:17.359303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b05c4f-db3c-4c88-8332-ee8a5e0b0909 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:17.359606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b05c4f-db3c-4c88-8332-ee8a5e0b0909 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:17.366173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b05c4f-db3c-4c88-8332-ee8a5e0b0909 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:17.367644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b05c4f-db3c-4c88-8332-ee8a5e0b0909 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-e4b05c4f-db3c-4c88-8332-ee8a5e0b0909 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:34:17.381297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:17.382211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:17.383277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:34:17.383277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:34:17.383277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:34:17.383277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:34:17.383277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:34:17.383277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:34:17.383277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:34:17.383277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:17.383277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 551/1075] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:34:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:17.388862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b2efa-eeca-4c2b-866a-5c2b763ed1ec None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:17.469448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:17.491608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b2efa-eeca-4c2b-866a-5c2b763ed1ec None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:17.525257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f99df-d039-41da-9224-dee1eda729bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:17.525913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f99df-d039-41da-9224-dee1eda729bc None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:17.526193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f99df-d039-41da-9224-dee1eda729bc None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:17.526465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f99df-d039-41da-9224-dee1eda729bc None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:17.527231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f99df-d039-41da-9224-dee1eda729bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:17.528301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f99df-d039-41da-9224-dee1eda729bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:17.529754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f99df-d039-41da-9224-dee1eda729bc None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:17.541696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 525/1076] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:34:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:17.547736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b05c4f-db3c-4c88-8332-ee8a5e0b0909 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:17.579594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:17.647034 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b05c4f-db3c-4c88-8332-ee8a5e0b0909 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:17.680073 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3afde-48ee-41aa-90c6-515aeaf04983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:17.680954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3afde-48ee-41aa-90c6-515aeaf04983 None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:17.681236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3afde-48ee-41aa-90c6-515aeaf04983 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:17.681512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3afde-48ee-41aa-90c6-515aeaf04983 None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/6aa3618089794b938018ff2666afebe3/roles/ce0dd8032e4943a59fd5fc51178f7aff` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:17.684394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3afde-48ee-41aa-90c6-515aeaf04983 None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=6aa3618089794b938018ff2666afebe3, role_id=ce0dd8032e4943a59fd5fc51178f7aff)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:17.685825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3afde-48ee-41aa-90c6-515aeaf04983 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:17.756206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 552/1077] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:34:17 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/6aa3618089794b938018ff2666afebe3/roles/ce0dd8032e4943a59fd5fc51178f7aff => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:34:18.083461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b1f8a-e9e9-42ab-a07a-f09fbe4bd74c None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:18.083973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b1f8a-e9e9-42ab-a07a-f09fbe4bd74c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:18.083973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b1f8a-e9e9-42ab-a07a-f09fbe4bd74c None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:18.085306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 526/1078] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:18.090707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddd136-e722-4ed1-a8c7-465b03432c03 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:18.090994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddd136-e722-4ed1-a8c7-465b03432c03 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:18.091276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddd136-e722-4ed1-a8c7-465b03432c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:18.108284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-21ddd136-e722-4ed1-a8c7-465b03432c03 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:18.109465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-21ddd136-e722-4ed1-a8c7-465b03432c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:18.176950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 553/1079] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:18.200139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b1f8a-e9e9-42ab-a07a-f09fbe4bd74c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:18.302675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b1f8a-e9e9-42ab-a07a-f09fbe4bd74c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:18.336506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622df64f-da8f-40eb-9a1e-77696ed0f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:18.337232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622df64f-da8f-40eb-9a1e-77696ed0f68f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:18.337517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622df64f-da8f-40eb-9a1e-77696ed0f68f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:18.337794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622df64f-da8f-40eb-9a1e-77696ed0f68f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:18.341262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:18.349281 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622df64f-da8f-40eb-9a1e-77696ed0f68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-622df64f-da8f-40eb-9a1e-77696ed0f68f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:34:18.357447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:18.366345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:18.367319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 527/1080] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:34:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:18.368092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddd136-e722-4ed1-a8c7-465b03432c03 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:18.390606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:18.469627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddd136-e722-4ed1-a8c7-465b03432c03 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:18.504211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476882e-8e42-481b-855f-eab900bc1112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:18.504882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476882e-8e42-481b-855f-eab900bc1112 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:18.505170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476882e-8e42-481b-855f-eab900bc1112 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:18.505450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476882e-8e42-481b-855f-eab900bc1112 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:18.506194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476882e-8e42-481b-855f-eab900bc1112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:18.506507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476882e-8e42-481b-855f-eab900bc1112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:18.507932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476882e-8e42-481b-855f-eab900bc1112 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:18.517140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 554/1081] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:34:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:18.522844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622df64f-da8f-40eb-9a1e-77696ed0f68f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:18.624285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622df64f-da8f-40eb-9a1e-77696ed0f68f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:18.657926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb12d28-9734-4fd0-a673-68a83225aaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:18.658789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb12d28-9734-4fd0-a673-68a83225aaa3 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:18.659074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb12d28-9734-4fd0-a673-68a83225aaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:18.659380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb12d28-9734-4fd0-a673-68a83225aaa3 None admin] PATH_INFO: `/v3/users/3bb948104b1f4db48adc1b52c7963e5f` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:18.660574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb12d28-9734-4fd0-a673-68a83225aaa3 None admin] RBAC: Authorizing `identity:get_user(user_id=3bb948104b1f4db48adc1b52c7963e5f)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:18.662015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb12d28-9734-4fd0-a673-68a83225aaa3 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:18.663694 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 528/1082] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:18 2022] GET /identity/v3/users/3bb948104b1f4db48adc1b52c7963e5f => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:18.670177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476882e-8e42-481b-855f-eab900bc1112 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:18.752062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:18.767920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476882e-8e42-481b-855f-eab900bc1112 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:18.801647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51017ca9-f874-4ff5-9a8c-4dc5f95453dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:18.802496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017ca9-f874-4ff5-9a8c-4dc5f95453dd None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:18.802776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017ca9-f874-4ff5-9a8c-4dc5f95453dd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:18.803053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017ca9-f874-4ff5-9a8c-4dc5f95453dd None admin] PATH_INFO: `/v3/projects/0fac89aeaebd47469ddb60149096d806` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:18.804250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51017ca9-f874-4ff5-9a8c-4dc5f95453dd None admin] RBAC: Authorizing `identity:get_project(project_id=0fac89aeaebd47469ddb60149096d806)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:18.805675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51017ca9-f874-4ff5-9a8c-4dc5f95453dd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:18.807563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 555/1083] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:34:18 2022] GET /identity/v3/projects/0fac89aeaebd47469ddb60149096d806 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:18.813359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb12d28-9734-4fd0-a673-68a83225aaa3 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:18.880517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:18.919623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb12d28-9734-4fd0-a673-68a83225aaa3 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:18.953720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395dbc5-9786-4444-bcd4-24ec0c221bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:18.954606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395dbc5-9786-4444-bcd4-24ec0c221bf4 None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:18.954885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395dbc5-9786-4444-bcd4-24ec0c221bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:18.955160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395dbc5-9786-4444-bcd4-24ec0c221bf4 None admin] PATH_INFO: `/v3/projects/0fac89aeaebd47469ddb60149096d806/users/3bb948104b1f4db48adc1b52c7963e5f/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:18.957151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395dbc5-9786-4444-bcd4-24ec0c221bf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fac89aeaebd47469ddb60149096d806, user_id=3bb948104b1f4db48adc1b52c7963e5f, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:18.958587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395dbc5-9786-4444-bcd4-24ec0c221bf4 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:19.058477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 529/1084] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:34:18 2022] PUT /identity/v3/projects/0fac89aeaebd47469ddb60149096d806/users/3bb948104b1f4db48adc1b52c7963e5f/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:34:19.872400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0dea8-bc16-419a-890c-dde00e0d3eb0 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:19.872929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0dea8-bc16-419a-890c-dde00e0d3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:19.873045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0dea8-bc16-419a-890c-dde00e0d3eb0 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:19.874307 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 556/1085] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:19.879545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3b5c4-ff32-4118-a4d1-f00f5b8cdd86 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:19.879938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3b5c4-ff32-4118-a4d1-f00f5b8cdd86 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:19.880095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3b5c4-ff32-4118-a4d1-f00f5b8cdd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:19.897623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-53f3b5c4-ff32-4118-a4d1-f00f5b8cdd86 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:19.898804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-53f3b5c4-ff32-4118-a4d1-f00f5b8cdd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:19.965880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 530/1086] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:19.989474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0dea8-bc16-419a-890c-dde00e0d3eb0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:20.087267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0dea8-bc16-419a-890c-dde00e0d3eb0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:20.121409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11328e-3561-49ec-be9c-1bc1944fc111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:20.122217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11328e-3561-49ec-be9c-1bc1944fc111 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:20.122554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11328e-3561-49ec-be9c-1bc1944fc111 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:20.122780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11328e-3561-49ec-be9c-1bc1944fc111 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:20.133042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11328e-3561-49ec-be9c-1bc1944fc111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-fe11328e-3561-49ec-be9c-1bc1944fc111 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:34:20.141412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:20.142582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 08:34:20.143704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:20.147559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 557/1087] 10.222.0.78 () {56 vars in 1120 bytes} [Fri Jun 17 08:34:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:20.149069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3b5c4-ff32-4118-a4d1-f00f5b8cdd86 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:20.205939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:20.249463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3b5c4-ff32-4118-a4d1-f00f5b8cdd86 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:20.284764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7afe-f2af-448d-8b66-1e9350ea992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:20.285422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7afe-f2af-448d-8b66-1e9350ea992d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:20.285700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7afe-f2af-448d-8b66-1e9350ea992d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:20.285967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf7afe-f2af-448d-8b66-1e9350ea992d None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:20.286697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf7afe-f2af-448d-8b66-1e9350ea992d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:20.286999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf7afe-f2af-448d-8b66-1e9350ea992d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:20.288395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf7afe-f2af-448d-8b66-1e9350ea992d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:20.296423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 531/1088] 10.222.0.78 () {56 vars in 1115 bytes} [Fri Jun 17 08:34:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:20.302044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11328e-3561-49ec-be9c-1bc1944fc111 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:20.317062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:20.400000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11328e-3561-49ec-be9c-1bc1944fc111 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:20.433190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f54bd-fa51-474c-a56c-6051eac247f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:20.433998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f54bd-fa51-474c-a56c-6051eac247f0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:20.434284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f54bd-fa51-474c-a56c-6051eac247f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:20.434565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f54bd-fa51-474c-a56c-6051eac247f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:20.446409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f54bd-fa51-474c-a56c-6051eac247f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:20.446409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f54bd-fa51-474c-a56c-6051eac247f0 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-1e1f54bd-fa51-474c-a56c-6051eac247f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:34:20.465899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:20.466951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:20.467915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:34:20.467915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:34:20.467915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:20.467915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:20.467915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 558/1089] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:34:20.472888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7afe-f2af-448d-8b66-1e9350ea992d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:20.569500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf7afe-f2af-448d-8b66-1e9350ea992d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:20.586504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:20.603759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f169d-e86b-4a40-89aa-7f1fce2dda4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:20.604412 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f169d-e86b-4a40-89aa-7f1fce2dda4e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:20.604690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f169d-e86b-4a40-89aa-7f1fce2dda4e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:20.604963 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f169d-e86b-4a40-89aa-7f1fce2dda4e None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:20.605693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f169d-e86b-4a40-89aa-7f1fce2dda4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:20.606079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f169d-e86b-4a40-89aa-7f1fce2dda4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:20.607381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f169d-e86b-4a40-89aa-7f1fce2dda4e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:20.619302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 532/1090] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:20.625349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f54bd-fa51-474c-a56c-6051eac247f0 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:20.686945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:20.724576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f54bd-fa51-474c-a56c-6051eac247f0 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:20.757648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368996d4-71a1-490a-a1ab-2103d8c4b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:20.758432 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368996d4-71a1-490a-a1ab-2103d8c4b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:20.758718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368996d4-71a1-490a-a1ab-2103d8c4b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:20.758995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368996d4-71a1-490a-a1ab-2103d8c4b1b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:20.767084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368996d4-71a1-490a-a1ab-2103d8c4b1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:20.768591 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368996d4-71a1-490a-a1ab-2103d8c4b1b1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-368996d4-71a1-490a-a1ab-2103d8c4b1b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:34:20.782549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:20.783651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:20.784607 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 559/1091] 10.222.0.78 () {56 vars in 1093 bytes} [Fri Jun 17 08:34:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:20.789448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f169d-e86b-4a40-89aa-7f1fce2dda4e None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:20.888117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f169d-e86b-4a40-89aa-7f1fce2dda4e None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:20.921809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26fead-cc62-4d97-a77d-00c52b412ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:20.922471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fead-cc62-4d97-a77d-00c52b412ca0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:20.922755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fead-cc62-4d97-a77d-00c52b412ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:20.923032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fead-cc62-4d97-a77d-00c52b412ca0 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:20.923889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26fead-cc62-4d97-a77d-00c52b412ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:20.924197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26fead-cc62-4d97-a77d-00c52b412ca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:20.925607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26fead-cc62-4d97-a77d-00c52b412ca0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:20.943368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 533/1092] 10.222.0.78 () {56 vars in 1133 bytes} [Fri Jun 17 08:34:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:20.948878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368996d4-71a1-490a-a1ab-2103d8c4b1b1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:21.048759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368996d4-71a1-490a-a1ab-2103d8c4b1b1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:21.070814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:21.083469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e486e-58d8-4c9d-b470-1b8eef94bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:21.084117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e486e-58d8-4c9d-b470-1b8eef94bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.084402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e486e-58d8-4c9d-b470-1b8eef94bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.084683 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e486e-58d8-4c9d-b470-1b8eef94bbb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.155321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e486e-58d8-4c9d-b470-1b8eef94bbb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:21.156835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e486e-58d8-4c9d-b470-1b8eef94bbb5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:21.204645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ca90-af82-42fd-86ad-e50a0c4813bd None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.204851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ca90-af82-42fd-86ad-e50a0c4813bd None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.205319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71ca90-af82-42fd-86ad-e50a0c4813bd None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.206693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 534/1093] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:34:21.211656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095e1e3-06da-49f0-8158-ce435ce0e9b5 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.211941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095e1e3-06da-49f0-8158-ce435ce0e9b5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.212217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095e1e3-06da-49f0-8158-ce435ce0e9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.228669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-a095e1e3-06da-49f0-8158-ce435ce0e9b5 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:21.229862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a095e1e3-06da-49f0-8158-ce435ce0e9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:21.257658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:21.262906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 560/1094] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:34:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:34:21.263887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e486e-58d8-4c9d-b470-1b8eef94bbb5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:21.289260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:21.300847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 535/1095] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:21.323780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095e1e3-06da-49f0-8158-ce435ce0e9b5 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:21.363175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e486e-58d8-4c9d-b470-1b8eef94bbb5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:21.396921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6f1eb-4ed0-4a06-afd6-fe724371dc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:21.397711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6f1eb-4ed0-4a06-afd6-fe724371dc64 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.397992 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6f1eb-4ed0-4a06-afd6-fe724371dc64 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.398267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6f1eb-4ed0-4a06-afd6-fe724371dc64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.409064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6f1eb-4ed0-4a06-afd6-fe724371dc64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:21.410495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6f1eb-4ed0-4a06-afd6-fe724371dc64 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:21.424548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095e1e3-06da-49f0-8158-ce435ce0e9b5 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-30b6f1eb-4ed0-4a06-afd6-fe724371dc64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:34:21.428423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:21.429311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:21.430220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:34:21.430220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:34:21.430220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:34:21.430220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:21.430220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 561/1096] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:34:21.435503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6f1eb-4ed0-4a06-afd6-fe724371dc64 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:21.461039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832737fd-ee3c-43a5-91a2-fa347178dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:21.462018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832737fd-ee3c-43a5-91a2-fa347178dd6c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.462310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832737fd-ee3c-43a5-91a2-fa347178dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.462584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832737fd-ee3c-43a5-91a2-fa347178dd6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.473165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832737fd-ee3c-43a5-91a2-fa347178dd6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-832737fd-ee3c-43a5-91a2-fa347178dd6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:34:21.481372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:21.482499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:21.483375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 536/1097] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:34:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:34:21.488315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832737fd-ee3c-43a5-91a2-fa347178dd6c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:21.513752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:21.514093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:21.536334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6f1eb-4ed0-4a06-afd6-fe724371dc64 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:21.572344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29256813-b782-4b7c-9b32-a39f1b51c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:21.572998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29256813-b782-4b7c-9b32-a39f1b51c00f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.573278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29256813-b782-4b7c-9b32-a39f1b51c00f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.573559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29256813-b782-4b7c-9b32-a39f1b51c00f None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.574552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29256813-b782-4b7c-9b32-a39f1b51c00f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:21.574855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29256813-b782-4b7c-9b32-a39f1b51c00f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:21.576274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29256813-b782-4b7c-9b32-a39f1b51c00f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:21.592473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 562/1098] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:21.592625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832737fd-ee3c-43a5-91a2-fa347178dd6c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:21.593461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29256813-b782-4b7c-9b32-a39f1b51c00f None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:21.623718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b76329-545d-447b-8b03-c96d0aeca337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:21.624375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b76329-545d-447b-8b03-c96d0aeca337 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.624654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b76329-545d-447b-8b03-c96d0aeca337 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.624927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b76329-545d-447b-8b03-c96d0aeca337 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.625662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b76329-545d-447b-8b03-c96d0aeca337 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:21.625965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b76329-545d-447b-8b03-c96d0aeca337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:21.627322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b76329-545d-447b-8b03-c96d0aeca337 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:21.635297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 537/1099] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:34:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:21.641239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b76329-545d-447b-8b03-c96d0aeca337 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:21.691172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29256813-b782-4b7c-9b32-a39f1b51c00f None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:21.727147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:21.727993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99d850-01ea-48fe-807e-ee16d603f4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:21.728968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99d850-01ea-48fe-807e-ee16d603f4e3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.729252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99d850-01ea-48fe-807e-ee16d603f4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.729533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99d850-01ea-48fe-807e-ee16d603f4e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.732531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:21.737015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99d850-01ea-48fe-807e-ee16d603f4e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:21.741036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99d850-01ea-48fe-807e-ee16d603f4e3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:21.741706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b76329-545d-447b-8b03-c96d0aeca337 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-cb99d850-01ea-48fe-807e-ee16d603f4e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:34:21.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:21.753733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:21.754662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:34:21.754662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:34:21.754662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:34:21.754662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:34:21.754662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:34:21.754662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:34:21.754662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:34:21.754662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:21.755588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 563/1100] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:34:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:21.759727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99d850-01ea-48fe-807e-ee16d603f4e3 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:21.776629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13066738-7534-4522-826f-50ece85fca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:21.778048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066738-7534-4522-826f-50ece85fca8c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.778329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066738-7534-4522-826f-50ece85fca8c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.778601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066738-7534-4522-826f-50ece85fca8c None admin] PATH_INFO: `/v3/users/3bb948104b1f4db48adc1b52c7963e5f` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.779807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13066738-7534-4522-826f-50ece85fca8c None admin] RBAC: Authorizing `identity:get_user(user_id=3bb948104b1f4db48adc1b52c7963e5f)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:21.781231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13066738-7534-4522-826f-50ece85fca8c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:21.782858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 538/1101] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:21 2022] GET /identity/v3/users/3bb948104b1f4db48adc1b52c7963e5f => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:21.788933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13066738-7534-4522-826f-50ece85fca8c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:21.860000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99d850-01ea-48fe-807e-ee16d603f4e3 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:21.885612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13066738-7534-4522-826f-50ece85fca8c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:21.893558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc830a4c-01f0-4474-8c91-8dad858fbabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:21.894207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc830a4c-01f0-4474-8c91-8dad858fbabb None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.894491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc830a4c-01f0-4474-8c91-8dad858fbabb None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.894768 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc830a4c-01f0-4474-8c91-8dad858fbabb None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.895578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc830a4c-01f0-4474-8c91-8dad858fbabb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:21.895889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc830a4c-01f0-4474-8c91-8dad858fbabb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:21.897304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc830a4c-01f0-4474-8c91-8dad858fbabb None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:21.909579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 564/1102] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:34:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:21.915489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc830a4c-01f0-4474-8c91-8dad858fbabb None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:21.921879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34740ee-aa53-4ac1-b663-7194551ab892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:21.922527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34740ee-aa53-4ac1-b663-7194551ab892 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:21.922833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34740ee-aa53-4ac1-b663-7194551ab892 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:21.923107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34740ee-aa53-4ac1-b663-7194551ab892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:21.947749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:21.971577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:21.992230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34740ee-aa53-4ac1-b663-7194551ab892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:21.995102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34740ee-aa53-4ac1-b663-7194551ab892 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:22.014457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc830a4c-01f0-4474-8c91-8dad858fbabb None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:22.047492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e9138-5c08-4e7c-8cee-d8015cceeb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:22.048137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e9138-5c08-4e7c-8cee-d8015cceeb6a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:22.048415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e9138-5c08-4e7c-8cee-d8015cceeb6a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:22.048689 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e9138-5c08-4e7c-8cee-d8015cceeb6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:22.049505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e9138-5c08-4e7c-8cee-d8015cceeb6a None admin] RBAC: Adding query filter params (role.id=ce0dd8032e4943a59fd5fc51178f7aff, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=6aa3618089794b938018ff2666afebe3) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:22.049814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e9138-5c08-4e7c-8cee-d8015cceeb6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:22.051221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e9138-5c08-4e7c-8cee-d8015cceeb6a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:22.056960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 565/1103] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:34:21 2022] GET /identity/v3/role_assignments?user.id=6aa3618089794b938018ff2666afebe3&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=ce0dd8032e4943a59fd5fc51178f7aff => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:34:22.094883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 539/1104] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:34:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:34:22.100926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e9138-5c08-4e7c-8cee-d8015cceeb6a None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:22.206749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e9138-5c08-4e7c-8cee-d8015cceeb6a None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:22.228481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:22.246318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b98018-cd7d-4a4b-8bb3-b6e1ae7f6eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:22.246318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b98018-cd7d-4a4b-8bb3-b6e1ae7f6eaf None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:22.246318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b98018-cd7d-4a4b-8bb3-b6e1ae7f6eaf None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:22.246318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b98018-cd7d-4a4b-8bb3-b6e1ae7f6eaf None admin] PATH_INFO: `/v3/projects/0fac89aeaebd47469ddb60149096d806` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:22.246751 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b98018-cd7d-4a4b-8bb3-b6e1ae7f6eaf None admin] RBAC: Authorizing `identity:get_project(project_id=0fac89aeaebd47469ddb60149096d806)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:22.248045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b98018-cd7d-4a4b-8bb3-b6e1ae7f6eaf None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:22.249746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 566/1105] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:34:22 2022] GET /identity/v3/projects/0fac89aeaebd47469ddb60149096d806 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:22.255910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34740ee-aa53-4ac1-b663-7194551ab892 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:22.317753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:22.366454 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34740ee-aa53-4ac1-b663-7194551ab892 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:22.401655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006bef-71c3-44df-bbc7-a48f569a2c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:22.402986 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006bef-71c3-44df-bbc7-a48f569a2c8b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:22.403230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006bef-71c3-44df-bbc7-a48f569a2c8b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:22.403421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006bef-71c3-44df-bbc7-a48f569a2c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:22.404253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff006bef-71c3-44df-bbc7-a48f569a2c8b None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=0fac89aeaebd47469ddb60149096d806, user.id=3bb948104b1f4db48adc1b52c7963e5f) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:22.404601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff006bef-71c3-44df-bbc7-a48f569a2c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:22.406022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff006bef-71c3-44df-bbc7-a48f569a2c8b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:22.412236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 540/1106] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:34:22 2022] GET /identity/v3/role_assignments?user.id=3bb948104b1f4db48adc1b52c7963e5f&scope.project.id=0fac89aeaebd47469ddb60149096d806&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:24.566599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457883d1-17ae-4d15-96c0-a5f3bb14992c None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:24.567155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457883d1-17ae-4d15-96c0-a5f3bb14992c None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:24.567155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457883d1-17ae-4d15-96c0-a5f3bb14992c None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:24.568533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 567/1107] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:24.573620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6d1f0-7fb6-4cf2-bf3a-0388fed8c071 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:24.574341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6d1f0-7fb6-4cf2-bf3a-0388fed8c071 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:24.574481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6d1f0-7fb6-4cf2-bf3a-0388fed8c071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:24.591315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-81d6d1f0-7fb6-4cf2-bf3a-0388fed8c071 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:24.592512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-81d6d1f0-7fb6-4cf2-bf3a-0388fed8c071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:24.656448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 541/1108] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:24.681323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457883d1-17ae-4d15-96c0-a5f3bb14992c None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:24.781329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457883d1-17ae-4d15-96c0-a5f3bb14992c None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:24.815012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77c7b1-a82a-4c4d-acb7-67e0b17dece1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:24.815813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77c7b1-a82a-4c4d-acb7-67e0b17dece1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:24.816096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77c7b1-a82a-4c4d-acb7-67e0b17dece1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:24.816372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77c7b1-a82a-4c4d-acb7-67e0b17dece1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:24.817516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77c7b1-a82a-4c4d-acb7-67e0b17dece1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:24.818944 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77c7b1-a82a-4c4d-acb7-67e0b17dece1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:24.820587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 568/1109] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:24.826602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6d1f0-7fb6-4cf2-bf3a-0388fed8c071 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:24.873419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:24.921493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6d1f0-7fb6-4cf2-bf3a-0388fed8c071 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:24.954023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22594a10-fbea-4337-9f97-2a8b1dacae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:24.954675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22594a10-fbea-4337-9f97-2a8b1dacae23 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:24.954953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22594a10-fbea-4337-9f97-2a8b1dacae23 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:24.955223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22594a10-fbea-4337-9f97-2a8b1dacae23 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:24.955949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22594a10-fbea-4337-9f97-2a8b1dacae23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:24.957353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22594a10-fbea-4337-9f97-2a8b1dacae23 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:25.050396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 542/1110] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:34:24 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:34:27.203123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca3938-504c-427a-8120-f5d9c4f4972a None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:27.203732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca3938-504c-427a-8120-f5d9c4f4972a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:27.203732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca3938-504c-427a-8120-f5d9c4f4972a None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:27.205051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 569/1111] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:27.210118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd7d0-8dad-4f5f-bc3e-cf4660a60ba2 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:27.210534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd7d0-8dad-4f5f-bc3e-cf4660a60ba2 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:27.210671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd7d0-8dad-4f5f-bc3e-cf4660a60ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:27.227408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-44bfd7d0-8dad-4f5f-bc3e-cf4660a60ba2 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:27.228580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-44bfd7d0-8dad-4f5f-bc3e-cf4660a60ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:27.292681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 543/1112] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:27.315809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca3938-504c-427a-8120-f5d9c4f4972a None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:27.371754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:27.414412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca3938-504c-427a-8120-f5d9c4f4972a None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:27.447850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d8af1-522f-438c-b00d-28d852f9fbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:27.448705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d8af1-522f-438c-b00d-28d852f9fbfb None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:27.449264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d8af1-522f-438c-b00d-28d852f9fbfb None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:27.449549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d8af1-522f-438c-b00d-28d852f9fbfb None admin] PATH_INFO: `/v3/roles/3ef6518e7cfb491dab86c245c0aeac21` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:27.451007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d8af1-522f-438c-b00d-28d852f9fbfb None admin] RBAC: Authorizing `identity:get_role(role_id=3ef6518e7cfb491dab86c245c0aeac21)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:27.452413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d8af1-522f-438c-b00d-28d852f9fbfb None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:27.453837 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 570/1113] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:27 2022] GET /identity/v3/roles/3ef6518e7cfb491dab86c245c0aeac21 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:27.459462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfd7d0-8dad-4f5f-bc3e-cf4660a60ba2 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:27.495075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:27.561582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfd7d0-8dad-4f5f-bc3e-cf4660a60ba2 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:27.594630 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f67ab-80af-41be-af4b-503774218c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:27.595519 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f67ab-80af-41be-af4b-503774218c11 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:27.595799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f67ab-80af-41be-af4b-503774218c11 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:27.596072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f67ab-80af-41be-af4b-503774218c11 None admin] PATH_INFO: `/v3/users/fc653547f00548feb8d76fc8e88f807e` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:27.609379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f67ab-80af-41be-af4b-503774218c11 None admin] RBAC: Authorizing `identity:get_user(user_id=fc653547f00548feb8d76fc8e88f807e)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:27.610805 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f67ab-80af-41be-af4b-503774218c11 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:27.612451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 544/1114] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:27 2022] GET /identity/v3/users/fc653547f00548feb8d76fc8e88f807e => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:27.618131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d8af1-522f-438c-b00d-28d852f9fbfb None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:27.714652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d8af1-522f-438c-b00d-28d852f9fbfb None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:27.737731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:27.748153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb9378-48c7-48d8-98b0-8a6799ca3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:27.758737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb9378-48c7-48d8-98b0-8a6799ca3bff None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:27.758737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb9378-48c7-48d8-98b0-8a6799ca3bff None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:27.758737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb9378-48c7-48d8-98b0-8a6799ca3bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:27.814391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb9378-48c7-48d8-98b0-8a6799ca3bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:27.815877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb9378-48c7-48d8-98b0-8a6799ca3bff None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:27.911315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 571/1115] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:34:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:34:27.917242 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f67ab-80af-41be-af4b-503774218c11 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:28.004718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:28.013506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f67ab-80af-41be-af4b-503774218c11 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:28.046693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152159b-aa6a-4d0a-b19c-00b97a10de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:28.047558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152159b-aa6a-4d0a-b19c-00b97a10de3a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:28.047841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152159b-aa6a-4d0a-b19c-00b97a10de3a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:28.048114 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152159b-aa6a-4d0a-b19c-00b97a10de3a None admin] PATH_INFO: `/v3/projects/0fac89aeaebd47469ddb60149096d806` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:28.049270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152159b-aa6a-4d0a-b19c-00b97a10de3a None admin] RBAC: Authorizing `identity:get_project(project_id=0fac89aeaebd47469ddb60149096d806)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:28.050683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152159b-aa6a-4d0a-b19c-00b97a10de3a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:28.052376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 545/1116] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:34:27 2022] GET /identity/v3/projects/0fac89aeaebd47469ddb60149096d806 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:28.059013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb9378-48c7-48d8-98b0-8a6799ca3bff None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:28.083292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:28.155887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb9378-48c7-48d8-98b0-8a6799ca3bff None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:28.190138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bffc5d-ae10-4f72-9d03-6d034b590dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:28.190780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bffc5d-ae10-4f72-9d03-6d034b590dcf None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:28.191064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bffc5d-ae10-4f72-9d03-6d034b590dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:28.191340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bffc5d-ae10-4f72-9d03-6d034b590dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:28.192194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bffc5d-ae10-4f72-9d03-6d034b590dcf None admin] RBAC: Adding query filter params (role.id=3ef6518e7cfb491dab86c245c0aeac21, scope.project.id=0fac89aeaebd47469ddb60149096d806, user.id=fc653547f00548feb8d76fc8e88f807e) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:28.192509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bffc5d-ae10-4f72-9d03-6d034b590dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:28.194007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bffc5d-ae10-4f72-9d03-6d034b590dcf None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:28.200362 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 572/1117] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:34:28 2022] GET /identity/v3/role_assignments?user.id=fc653547f00548feb8d76fc8e88f807e&scope.project.id=0fac89aeaebd47469ddb60149096d806&role.id=3ef6518e7cfb491dab86c245c0aeac21 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:30.281124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99f9bc-0194-4a94-b727-7b9b9aa0b0ca None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:30.281664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99f9bc-0194-4a94-b727-7b9b9aa0b0ca None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:30.281664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99f9bc-0194-4a94-b727-7b9b9aa0b0ca None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:30.283020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 546/1118] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:30.288308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820044a-a8a2-40bb-aa86-bbf2ef2e9059 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:30.288738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820044a-a8a2-40bb-aa86-bbf2ef2e9059 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:30.288880 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820044a-a8a2-40bb-aa86-bbf2ef2e9059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:30.305899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-2820044a-a8a2-40bb-aa86-bbf2ef2e9059 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:30.307075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2820044a-a8a2-40bb-aa86-bbf2ef2e9059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:30.371817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 573/1119] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:30.393814 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99f9bc-0194-4a94-b727-7b9b9aa0b0ca None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:30.494139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99f9bc-0194-4a94-b727-7b9b9aa0b0ca None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:30.528075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f625023-cce6-4f79-9768-72f85935f08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:30.529004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625023-cce6-4f79-9768-72f85935f08b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:30.529288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625023-cce6-4f79-9768-72f85935f08b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:30.529559 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f625023-cce6-4f79-9768-72f85935f08b None admin] PATH_INFO: `/v3/roles/3ef6518e7cfb491dab86c245c0aeac21` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:30.531227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f625023-cce6-4f79-9768-72f85935f08b None admin] RBAC: Authorizing `identity:get_role(role_id=3ef6518e7cfb491dab86c245c0aeac21)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:30.532603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f625023-cce6-4f79-9768-72f85935f08b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:30.534061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 547/1120] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:30 2022] GET /identity/v3/roles/3ef6518e7cfb491dab86c245c0aeac21 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:30.540345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820044a-a8a2-40bb-aa86-bbf2ef2e9059 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:30.560430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:30.641423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820044a-a8a2-40bb-aa86-bbf2ef2e9059 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:30.674775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82613c8-4601-4790-a78c-7e04a12c39c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:30.675674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82613c8-4601-4790-a78c-7e04a12c39c1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:30.675963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82613c8-4601-4790-a78c-7e04a12c39c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:30.676243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82613c8-4601-4790-a78c-7e04a12c39c1 None admin] PATH_INFO: `/v3/users/fc653547f00548feb8d76fc8e88f807e` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:30.677421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82613c8-4601-4790-a78c-7e04a12c39c1 None admin] RBAC: Authorizing `identity:get_user(user_id=fc653547f00548feb8d76fc8e88f807e)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:30.678870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82613c8-4601-4790-a78c-7e04a12c39c1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:30.680522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 574/1121] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:30 2022] GET /identity/v3/users/fc653547f00548feb8d76fc8e88f807e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:30.686572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f625023-cce6-4f79-9768-72f85935f08b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:30.714170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:30.784660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f625023-cce6-4f79-9768-72f85935f08b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:30.817176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752677d-da67-4989-ac81-bb67d8bca70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:30.818015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752677d-da67-4989-ac81-bb67d8bca70e None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:30.818298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752677d-da67-4989-ac81-bb67d8bca70e None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:30.818574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752677d-da67-4989-ac81-bb67d8bca70e None admin] PATH_INFO: `/v3/projects/0fac89aeaebd47469ddb60149096d806` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:30.819757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752677d-da67-4989-ac81-bb67d8bca70e None admin] RBAC: Authorizing `identity:get_project(project_id=0fac89aeaebd47469ddb60149096d806)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:30.821198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752677d-da67-4989-ac81-bb67d8bca70e None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:30.822866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 548/1122] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:34:30 2022] GET /identity/v3/projects/0fac89aeaebd47469ddb60149096d806 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:30.829272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82613c8-4601-4790-a78c-7e04a12c39c1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:30.911506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:30.925756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82613c8-4601-4790-a78c-7e04a12c39c1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:30.959312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c58d11-6d4f-4aaa-84c7-e0a4c760c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:30.960217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c58d11-6d4f-4aaa-84c7-e0a4c760c31f None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:30.960505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c58d11-6d4f-4aaa-84c7-e0a4c760c31f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:30.960787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c58d11-6d4f-4aaa-84c7-e0a4c760c31f None admin] PATH_INFO: `/v3/projects/0fac89aeaebd47469ddb60149096d806/users/fc653547f00548feb8d76fc8e88f807e/roles/3ef6518e7cfb491dab86c245c0aeac21` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:30.962968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c58d11-6d4f-4aaa-84c7-e0a4c760c31f None admin] RBAC: Authorizing `identity:create_grant(project_id=0fac89aeaebd47469ddb60149096d806, user_id=fc653547f00548feb8d76fc8e88f807e, role_id=3ef6518e7cfb491dab86c245c0aeac21)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:30.965091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c58d11-6d4f-4aaa-84c7-e0a4c760c31f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:31.030384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 575/1123] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:34:30 2022] PUT /identity/v3/projects/0fac89aeaebd47469ddb60149096d806/users/fc653547f00548feb8d76fc8e88f807e/roles/3ef6518e7cfb491dab86c245c0aeac21 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:34:33.124839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47d548-ce6b-43b5-89bc-9cc573807899 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:33.125371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47d548-ce6b-43b5-89bc-9cc573807899 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:33.125371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47d548-ce6b-43b5-89bc-9cc573807899 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:33.126755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 549/1124] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:33.132100 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4e5b7-bfab-47c6-a98d-8665448894f0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:33.132525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4e5b7-bfab-47c6-a98d-8665448894f0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:33.132658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4e5b7-bfab-47c6-a98d-8665448894f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:33.149565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a1a4e5b7-bfab-47c6-a98d-8665448894f0 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:33.150749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a1a4e5b7-bfab-47c6-a98d-8665448894f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:33.216000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 576/1125] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:33.239138 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47d548-ce6b-43b5-89bc-9cc573807899 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:33.329628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:33.336093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47d548-ce6b-43b5-89bc-9cc573807899 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:33.368762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e55d-0811-4b96-86eb-4166ead5248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:33.369600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e55d-0811-4b96-86eb-4166ead5248f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:33.369886 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e55d-0811-4b96-86eb-4166ead5248f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:33.370167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e55d-0811-4b96-86eb-4166ead5248f None admin] PATH_INFO: `/v3/roles/3ef6518e7cfb491dab86c245c0aeac21` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:33.372322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839e55d-0811-4b96-86eb-4166ead5248f None admin] RBAC: Authorizing `identity:get_role(role_id=3ef6518e7cfb491dab86c245c0aeac21)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:33.373687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839e55d-0811-4b96-86eb-4166ead5248f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:33.375087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 550/1126] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:33 2022] GET /identity/v3/roles/3ef6518e7cfb491dab86c245c0aeac21 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:33.380715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4e5b7-bfab-47c6-a98d-8665448894f0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:33.454477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:33.476399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4e5b7-bfab-47c6-a98d-8665448894f0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:33.512962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecd678-fde3-46fc-95c9-8244fdb03dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:33.513825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecd678-fde3-46fc-95c9-8244fdb03dcb None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:33.514108 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecd678-fde3-46fc-95c9-8244fdb03dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:33.514386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecd678-fde3-46fc-95c9-8244fdb03dcb None admin] PATH_INFO: `/v3/users/fc653547f00548feb8d76fc8e88f807e` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:33.515619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecd678-fde3-46fc-95c9-8244fdb03dcb None admin] RBAC: Authorizing `identity:get_user(user_id=fc653547f00548feb8d76fc8e88f807e)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:33.517060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecd678-fde3-46fc-95c9-8244fdb03dcb None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:33.518680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 577/1127] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:33 2022] GET /identity/v3/users/fc653547f00548feb8d76fc8e88f807e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:33.524382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e55d-0811-4b96-86eb-4166ead5248f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:33.621348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e55d-0811-4b96-86eb-4166ead5248f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:33.654591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b78dd7-e47f-4af6-8627-26bad46cd060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:33.655164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78dd7-e47f-4af6-8627-26bad46cd060 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:33.655476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78dd7-e47f-4af6-8627-26bad46cd060 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:33.655755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78dd7-e47f-4af6-8627-26bad46cd060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:33.685761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:33.721174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b78dd7-e47f-4af6-8627-26bad46cd060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:33.722609 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b78dd7-e47f-4af6-8627-26bad46cd060 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:33.817148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 551/1128] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:34:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 08:34:33.823048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecd678-fde3-46fc-95c9-8244fdb03dcb None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:33.919118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecd678-fde3-46fc-95c9-8244fdb03dcb None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:33.952387 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f889da-c664-4672-9258-3259287afd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:33.953244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f889da-c664-4672-9258-3259287afd63 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:33.953521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f889da-c664-4672-9258-3259287afd63 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:33.953794 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f889da-c664-4672-9258-3259287afd63 None admin] PATH_INFO: `/v3/projects/0fac89aeaebd47469ddb60149096d806` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:33.954957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f889da-c664-4672-9258-3259287afd63 None admin] RBAC: Authorizing `identity:get_project(project_id=0fac89aeaebd47469ddb60149096d806)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:33.956410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f889da-c664-4672-9258-3259287afd63 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:33.958102 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 578/1129] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:34:33 2022] GET /identity/v3/projects/0fac89aeaebd47469ddb60149096d806 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:33.964195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b78dd7-e47f-4af6-8627-26bad46cd060 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:34.026135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:34.063781 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b78dd7-e47f-4af6-8627-26bad46cd060 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:34.097246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7978994-0313-414b-b9a6-2596fbc3a3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:34.097887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7978994-0313-414b-b9a6-2596fbc3a3e0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:34.098174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7978994-0313-414b-b9a6-2596fbc3a3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:34.098453 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7978994-0313-414b-b9a6-2596fbc3a3e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:34.099268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7978994-0313-414b-b9a6-2596fbc3a3e0 None admin] RBAC: Adding query filter params (role.id=3ef6518e7cfb491dab86c245c0aeac21, scope.project.id=0fac89aeaebd47469ddb60149096d806, user.id=fc653547f00548feb8d76fc8e88f807e) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:34.099604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7978994-0313-414b-b9a6-2596fbc3a3e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:34.101032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7978994-0313-414b-b9a6-2596fbc3a3e0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:34.107586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 552/1130] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:34:33 2022] GET /identity/v3/role_assignments?user.id=fc653547f00548feb8d76fc8e88f807e&scope.project.id=0fac89aeaebd47469ddb60149096d806&role.id=3ef6518e7cfb491dab86c245c0aeac21 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:36.237104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea771fe-b82f-4ed9-800c-011ac28c8696 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:36.237631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea771fe-b82f-4ed9-800c-011ac28c8696 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:36.237631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea771fe-b82f-4ed9-800c-011ac28c8696 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:36.238996 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 579/1131] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:36.244199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fed35-6dc5-4c3d-9310-41354f483a1b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:36.244608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fed35-6dc5-4c3d-9310-41354f483a1b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:36.244754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fed35-6dc5-4c3d-9310-41354f483a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:36.261964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-6f5fed35-6dc5-4c3d-9310-41354f483a1b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:36.263151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-6f5fed35-6dc5-4c3d-9310-41354f483a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:36.328186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 553/1132] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:36.351377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea771fe-b82f-4ed9-800c-011ac28c8696 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:36.366413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:36.451855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea771fe-b82f-4ed9-800c-011ac28c8696 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:36.485722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fb90a-3fa9-42a8-9e23-b028d3e9debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:36.486497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fb90a-3fa9-42a8-9e23-b028d3e9debc None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:36.486775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fb90a-3fa9-42a8-9e23-b028d3e9debc None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:36.487047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fb90a-3fa9-42a8-9e23-b028d3e9debc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:36.488286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fb90a-3fa9-42a8-9e23-b028d3e9debc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:36.489658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fb90a-3fa9-42a8-9e23-b028d3e9debc None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:36.491259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 580/1133] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:36.496958 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fed35-6dc5-4c3d-9310-41354f483a1b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:36.552624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:36.592869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fed35-6dc5-4c3d-9310-41354f483a1b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:36.625728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190b74d-6041-4925-95e4-9b71c9ebdb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:36.626387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190b74d-6041-4925-95e4-9b71c9ebdb1a None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:36.626667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190b74d-6041-4925-95e4-9b71c9ebdb1a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:36.626941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190b74d-6041-4925-95e4-9b71c9ebdb1a None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:36.627672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190b74d-6041-4925-95e4-9b71c9ebdb1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:36.629090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190b74d-6041-4925-95e4-9b71c9ebdb1a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:36.743084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 554/1134] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:34:36 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:34:38.865359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1bad-42ce-4098-b76c-0c8f8799722e None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:38.865894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1bad-42ce-4098-b76c-0c8f8799722e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:38.865894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1bad-42ce-4098-b76c-0c8f8799722e None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:38.867243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 581/1135] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:38.872822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1bf2f-9eb7-4022-a19e-2e5fc3536145 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:38.873239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1bf2f-9eb7-4022-a19e-2e5fc3536145 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:38.873386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1bf2f-9eb7-4022-a19e-2e5fc3536145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:38.890328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b8d1bf2f-9eb7-4022-a19e-2e5fc3536145 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:38.891534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b8d1bf2f-9eb7-4022-a19e-2e5fc3536145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:38.956845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 555/1136] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:38.981650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd1bad-42ce-4098-b76c-0c8f8799722e None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:39.062315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:39.081942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd1bad-42ce-4098-b76c-0c8f8799722e None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:39.115101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcc731-60b9-42d6-80be-beb3d6655291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:39.115950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcc731-60b9-42d6-80be-beb3d6655291 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:39.116184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcc731-60b9-42d6-80be-beb3d6655291 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:39.116459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcc731-60b9-42d6-80be-beb3d6655291 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:39.117612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcc731-60b9-42d6-80be-beb3d6655291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:39.119035 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcc731-60b9-42d6-80be-beb3d6655291 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:39.121244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 582/1137] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:39.126994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1bf2f-9eb7-4022-a19e-2e5fc3536145 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:39.168129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:39.227518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1bf2f-9eb7-4022-a19e-2e5fc3536145 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:39.262401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc72e7d-7d7a-4e58-aec3-a73551bf2ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:39.263070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72e7d-7d7a-4e58-aec3-a73551bf2ed5 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:39.263371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72e7d-7d7a-4e58-aec3-a73551bf2ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:39.263668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc72e7d-7d7a-4e58-aec3-a73551bf2ed5 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:39.264387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc72e7d-7d7a-4e58-aec3-a73551bf2ed5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:39.265820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc72e7d-7d7a-4e58-aec3-a73551bf2ed5 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:39.356211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 556/1138] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:34:39 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:34:41.517234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6230df-c2bb-4f9b-b6a7-a4362fdc2774 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:41.517816 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6230df-c2bb-4f9b-b6a7-a4362fdc2774 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:41.517963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6230df-c2bb-4f9b-b6a7-a4362fdc2774 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:41.519257 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 583/1139] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:41.524441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54165f3-5813-4b94-b535-4a976ab65d9b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:41.524875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54165f3-5813-4b94-b535-4a976ab65d9b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:41.524982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54165f3-5813-4b94-b535-4a976ab65d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:41.541982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d54165f3-5813-4b94-b535-4a976ab65d9b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:41.543224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d54165f3-5813-4b94-b535-4a976ab65d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:41.607466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 557/1140] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:41.630531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6230df-c2bb-4f9b-b6a7-a4362fdc2774 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:41.728346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6230df-c2bb-4f9b-b6a7-a4362fdc2774 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:41.762158 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65a5ea-b805-4881-ac10-2025cd49db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:41.762924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a5ea-b805-4881-ac10-2025cd49db27 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:41.763205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a5ea-b805-4881-ac10-2025cd49db27 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:41.763522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a5ea-b805-4881-ac10-2025cd49db27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:41.773342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65a5ea-b805-4881-ac10-2025cd49db27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-cb65a5ea-b805-4881-ac10-2025cd49db27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:34:41.781129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:41.782251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:41.783138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 584/1141] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:41.788284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54165f3-5813-4b94-b535-4a976ab65d9b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:41.814799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:41.884525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54165f3-5813-4b94-b535-4a976ab65d9b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:41.918929 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b6d7d-4d85-4335-934a-40b1e63dd251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:41.919613 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6d7d-4d85-4335-934a-40b1e63dd251 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:41.919897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6d7d-4d85-4335-934a-40b1e63dd251 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:41.920171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b6d7d-4d85-4335-934a-40b1e63dd251 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:41.920901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b6d7d-4d85-4335-934a-40b1e63dd251 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:41.921207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b6d7d-4d85-4335-934a-40b1e63dd251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:41.922578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b6d7d-4d85-4335-934a-40b1e63dd251 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:41.930483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 558/1142] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:34:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:41.936888 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65a5ea-b805-4881-ac10-2025cd49db27 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:41.948101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:42.033381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65a5ea-b805-4881-ac10-2025cd49db27 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:42.067367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d00166-abf9-4e33-88cc-ad4f04492ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:42.068240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00166-abf9-4e33-88cc-ad4f04492ee8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:42.068527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00166-abf9-4e33-88cc-ad4f04492ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:42.068804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d00166-abf9-4e33-88cc-ad4f04492ee8 None admin] PATH_INFO: `/v3/users/d898cf727d1446b2abce843a9018f514` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:42.081870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d00166-abf9-4e33-88cc-ad4f04492ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=d898cf727d1446b2abce843a9018f514)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:42.083314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d00166-abf9-4e33-88cc-ad4f04492ee8 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:42.084969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 585/1143] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:41 2022] GET /identity/v3/users/d898cf727d1446b2abce843a9018f514 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:42.090849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b6d7d-4d85-4335-934a-40b1e63dd251 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:42.176041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:42.187792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b6d7d-4d85-4335-934a-40b1e63dd251 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:42.220332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854d607-fceb-4a9c-87c2-d4da10b7f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:42.220959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854d607-fceb-4a9c-87c2-d4da10b7f121 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:42.221240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854d607-fceb-4a9c-87c2-d4da10b7f121 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:42.221513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854d607-fceb-4a9c-87c2-d4da10b7f121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:42.286095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854d607-fceb-4a9c-87c2-d4da10b7f121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:42.287487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854d607-fceb-4a9c-87c2-d4da10b7f121 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:42.369638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:42.381647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 559/1144] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:34:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:34:42.387709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d00166-abf9-4e33-88cc-ad4f04492ee8 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:42.451639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:42.487233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d00166-abf9-4e33-88cc-ad4f04492ee8 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:42.530719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a5887-1e5e-4f2a-9b5e-92ea6e778a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:42.531603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5887-1e5e-4f2a-9b5e-92ea6e778a69 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:42.531887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5887-1e5e-4f2a-9b5e-92ea6e778a69 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:42.532162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a5887-1e5e-4f2a-9b5e-92ea6e778a69 None admin] PATH_INFO: `/v3/projects/4d10556ed9d049578483e97073335a4d` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:42.533333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a5887-1e5e-4f2a-9b5e-92ea6e778a69 None admin] RBAC: Authorizing `identity:get_project(project_id=4d10556ed9d049578483e97073335a4d)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:42.534757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a5887-1e5e-4f2a-9b5e-92ea6e778a69 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:42.536523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 586/1145] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:34:42 2022] GET /identity/v3/projects/4d10556ed9d049578483e97073335a4d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:42.543295 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854d607-fceb-4a9c-87c2-d4da10b7f121 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:42.638297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854d607-fceb-4a9c-87c2-d4da10b7f121 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:42.671552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db21194-757b-471c-a922-62ad95ada9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:42.672451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db21194-757b-471c-a922-62ad95ada9bf None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:42.672735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db21194-757b-471c-a922-62ad95ada9bf None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:42.673007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db21194-757b-471c-a922-62ad95ada9bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:42.673815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db21194-757b-471c-a922-62ad95ada9bf None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=4d10556ed9d049578483e97073335a4d, user.id=d898cf727d1446b2abce843a9018f514) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:42.674121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db21194-757b-471c-a922-62ad95ada9bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:42.675553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db21194-757b-471c-a922-62ad95ada9bf None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:42.680826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 560/1146] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:34:42 2022] GET /identity/v3/role_assignments?user.id=d898cf727d1446b2abce843a9018f514&scope.project.id=4d10556ed9d049578483e97073335a4d&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:44.766078 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc91538-c491-46e6-87ce-4b7e16741bb9 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:44.766591 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc91538-c491-46e6-87ce-4b7e16741bb9 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:44.766702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc91538-c491-46e6-87ce-4b7e16741bb9 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:44.768020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 587/1147] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:44.773199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336c0ef-9077-4654-b463-8379eb0d257c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:44.773582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336c0ef-9077-4654-b463-8379eb0d257c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:44.773751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336c0ef-9077-4654-b463-8379eb0d257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:44.790098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2336c0ef-9077-4654-b463-8379eb0d257c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:44.791267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2336c0ef-9077-4654-b463-8379eb0d257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:44.845393 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:44.864291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 561/1148] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:44.887536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc91538-c491-46e6-87ce-4b7e16741bb9 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:44.986197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc91538-c491-46e6-87ce-4b7e16741bb9 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:45.018898 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263e29f-6651-4b8d-8c6a-04862e88039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:45.019639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e29f-6651-4b8d-8c6a-04862e88039e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:45.019924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e29f-6651-4b8d-8c6a-04862e88039e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:45.020197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e29f-6651-4b8d-8c6a-04862e88039e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:45.022004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:45.030636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263e29f-6651-4b8d-8c6a-04862e88039e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-3263e29f-6651-4b8d-8c6a-04862e88039e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:34:45.038208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:45.039267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:45.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 588/1149] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:34:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:45.046530 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336c0ef-9077-4654-b463-8379eb0d257c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:45.143403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336c0ef-9077-4654-b463-8379eb0d257c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:45.176056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71be4c0-4678-4633-9706-9c371e265a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:45.176705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be4c0-4678-4633-9706-9c371e265a21 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:45.176986 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be4c0-4678-4633-9706-9c371e265a21 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:45.177258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be4c0-4678-4633-9706-9c371e265a21 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:45.177989 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71be4c0-4678-4633-9706-9c371e265a21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:45.178293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71be4c0-4678-4633-9706-9c371e265a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:45.179765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71be4c0-4678-4633-9706-9c371e265a21 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:45.188144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 562/1150] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:34:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:45.193858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263e29f-6651-4b8d-8c6a-04862e88039e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:45.293132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263e29f-6651-4b8d-8c6a-04862e88039e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:45.326129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105708ae-e6d8-481a-bc19-c036fbc8904d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:45.326987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105708ae-e6d8-481a-bc19-c036fbc8904d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:45.327270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105708ae-e6d8-481a-bc19-c036fbc8904d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:45.327574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105708ae-e6d8-481a-bc19-c036fbc8904d None admin] PATH_INFO: `/v3/users/d898cf727d1446b2abce843a9018f514` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:45.328754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105708ae-e6d8-481a-bc19-c036fbc8904d None admin] RBAC: Authorizing `identity:get_user(user_id=d898cf727d1446b2abce843a9018f514)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:45.330182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105708ae-e6d8-481a-bc19-c036fbc8904d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:45.331844 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 589/1151] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:45 2022] GET /identity/v3/users/d898cf727d1446b2abce843a9018f514 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:45.337672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71be4c0-4678-4633-9706-9c371e265a21 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:45.382033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:45.435294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71be4c0-4678-4633-9706-9c371e265a21 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:45.469359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b7aaf-9023-4c06-9112-e0d2e1789513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:45.470215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b7aaf-9023-4c06-9112-e0d2e1789513 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:45.470494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b7aaf-9023-4c06-9112-e0d2e1789513 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:45.470768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b7aaf-9023-4c06-9112-e0d2e1789513 None admin] PATH_INFO: `/v3/projects/4d10556ed9d049578483e97073335a4d` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:45.471955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b7aaf-9023-4c06-9112-e0d2e1789513 None admin] RBAC: Authorizing `identity:get_project(project_id=4d10556ed9d049578483e97073335a4d)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:45.473370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b7aaf-9023-4c06-9112-e0d2e1789513 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:45.475059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 563/1152] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:34:45 2022] GET /identity/v3/projects/4d10556ed9d049578483e97073335a4d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:45.481231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105708ae-e6d8-481a-bc19-c036fbc8904d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:45.542279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:45.581380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105708ae-e6d8-481a-bc19-c036fbc8904d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:45.613854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf46709-3349-4d3f-a624-18e2fe8b131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:45.614731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf46709-3349-4d3f-a624-18e2fe8b131d None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:45.615017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf46709-3349-4d3f-a624-18e2fe8b131d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:45.615296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf46709-3349-4d3f-a624-18e2fe8b131d None admin] PATH_INFO: `/v3/projects/4d10556ed9d049578483e97073335a4d/users/d898cf727d1446b2abce843a9018f514/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:45.617264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf46709-3349-4d3f-a624-18e2fe8b131d None admin] RBAC: Authorizing `identity:create_grant(project_id=4d10556ed9d049578483e97073335a4d, user_id=d898cf727d1446b2abce843a9018f514, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:45.618693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf46709-3349-4d3f-a624-18e2fe8b131d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:45.704826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 590/1153] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:34:45 2022] PUT /identity/v3/projects/4d10556ed9d049578483e97073335a4d/users/d898cf727d1446b2abce843a9018f514/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:34:47.950983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892f4a-35c9-4d40-83b3-c43dc2547e2f None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:47.951618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892f4a-35c9-4d40-83b3-c43dc2547e2f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:47.951618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892f4a-35c9-4d40-83b3-c43dc2547e2f None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:47.952963 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 564/1154] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:47.958347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94937-84a7-4479-b1dd-4c3112359c6b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:47.958786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94937-84a7-4479-b1dd-4c3112359c6b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:47.958905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94937-84a7-4479-b1dd-4c3112359c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:47.976323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-94f94937-84a7-4479-b1dd-4c3112359c6b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:47.977547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-94f94937-84a7-4479-b1dd-4c3112359c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:48.044329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 591/1155] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:48.068315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa892f4a-35c9-4d40-83b3-c43dc2547e2f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:48.170795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa892f4a-35c9-4d40-83b3-c43dc2547e2f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:48.184840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:48.206302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb850bb-1ff1-40bc-a8ff-0855a70838f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:48.207018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb850bb-1ff1-40bc-a8ff-0855a70838f5 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:48.207304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb850bb-1ff1-40bc-a8ff-0855a70838f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:48.207617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb850bb-1ff1-40bc-a8ff-0855a70838f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:48.218584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb850bb-1ff1-40bc-a8ff-0855a70838f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-8bb850bb-1ff1-40bc-a8ff-0855a70838f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:34:48.226561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:48.227867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:34:48.228872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 565/1156] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:48.234097 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94937-84a7-4479-b1dd-4c3112359c6b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:48.284416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:48.330224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94937-84a7-4479-b1dd-4c3112359c6b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:48.367203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9454b9-a4b5-4abb-a28c-a764fb753035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:48.367896 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9454b9-a4b5-4abb-a28c-a764fb753035 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:48.368178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9454b9-a4b5-4abb-a28c-a764fb753035 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:48.368453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9454b9-a4b5-4abb-a28c-a764fb753035 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:48.369193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9454b9-a4b5-4abb-a28c-a764fb753035 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:48.369499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9454b9-a4b5-4abb-a28c-a764fb753035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:48.371469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9454b9-a4b5-4abb-a28c-a764fb753035 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:48.379290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 592/1157] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:34:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:48.385321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb850bb-1ff1-40bc-a8ff-0855a70838f5 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:48.484598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb850bb-1ff1-40bc-a8ff-0855a70838f5 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:48.517616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5fe0-717a-4612-883d-4ac8d173fdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:48.518465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5fe0-717a-4612-883d-4ac8d173fdac None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:48.518745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5fe0-717a-4612-883d-4ac8d173fdac None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:48.519018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5fe0-717a-4612-883d-4ac8d173fdac None admin] PATH_INFO: `/v3/users/d898cf727d1446b2abce843a9018f514` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:48.520210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f5fe0-717a-4612-883d-4ac8d173fdac None admin] RBAC: Authorizing `identity:get_user(user_id=d898cf727d1446b2abce843a9018f514)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:48.521630 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f5fe0-717a-4612-883d-4ac8d173fdac None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:48.523231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 566/1158] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:34:48 2022] GET /identity/v3/users/d898cf727d1446b2abce843a9018f514 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:48.529128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9454b9-a4b5-4abb-a28c-a764fb753035 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:48.624488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9454b9-a4b5-4abb-a28c-a764fb753035 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:48.638370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:48.657640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e71cb-5027-4379-9434-e6bf6d6e3530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:48.658280 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e71cb-5027-4379-9434-e6bf6d6e3530 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:48.658563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e71cb-5027-4379-9434-e6bf6d6e3530 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:48.658839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e71cb-5027-4379-9434-e6bf6d6e3530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:48.723759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e71cb-5027-4379-9434-e6bf6d6e3530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:48.725200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e71cb-5027-4379-9434-e6bf6d6e3530 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:48.819422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 593/1159] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:34:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:34:48.825558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5fe0-717a-4612-883d-4ac8d173fdac None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:48.866400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:48.923536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5fe0-717a-4612-883d-4ac8d173fdac None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:48.957230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80db83-5f06-4cc7-947e-a341373f2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:48.958068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80db83-5f06-4cc7-947e-a341373f2c53 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:48.958350 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80db83-5f06-4cc7-947e-a341373f2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:48.958623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80db83-5f06-4cc7-947e-a341373f2c53 None admin] PATH_INFO: `/v3/projects/4d10556ed9d049578483e97073335a4d` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:48.959809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80db83-5f06-4cc7-947e-a341373f2c53 None admin] RBAC: Authorizing `identity:get_project(project_id=4d10556ed9d049578483e97073335a4d)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:48.961233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80db83-5f06-4cc7-947e-a341373f2c53 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:48.962900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 567/1160] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:34:48 2022] GET /identity/v3/projects/4d10556ed9d049578483e97073335a4d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:48.969567 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e71cb-5027-4379-9434-e6bf6d6e3530 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:48.984050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:49.064598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e71cb-5027-4379-9434-e6bf6d6e3530 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:49.097419 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adc33f-5e4d-4eee-8c3f-27012779f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:49.097989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc33f-5e4d-4eee-8c3f-27012779f989 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:49.098269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc33f-5e4d-4eee-8c3f-27012779f989 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:49.098546 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adc33f-5e4d-4eee-8c3f-27012779f989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:49.099384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adc33f-5e4d-4eee-8c3f-27012779f989 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=4d10556ed9d049578483e97073335a4d, user.id=d898cf727d1446b2abce843a9018f514) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:49.099698 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adc33f-5e4d-4eee-8c3f-27012779f989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:49.101150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adc33f-5e4d-4eee-8c3f-27012779f989 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:49.107171 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 594/1161] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:34:48 2022] GET /identity/v3/role_assignments?user.id=d898cf727d1446b2abce843a9018f514&scope.project.id=4d10556ed9d049578483e97073335a4d&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:51.227937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed14ead-c21b-43de-9b23-39ae11fc16b6 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:51.228499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed14ead-c21b-43de-9b23-39ae11fc16b6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:51.228499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed14ead-c21b-43de-9b23-39ae11fc16b6 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:51.230362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 568/1162] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:51.235424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743dcb-23d8-41df-b7d4-e9bacc8da4fa None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:51.235843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743dcb-23d8-41df-b7d4-e9bacc8da4fa None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:51.235989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5743dcb-23d8-41df-b7d4-e9bacc8da4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:51.253201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-e5743dcb-23d8-41df-b7d4-e9bacc8da4fa None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:51.254391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e5743dcb-23d8-41df-b7d4-e9bacc8da4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:51.320901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 595/1163] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:51.343721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed14ead-c21b-43de-9b23-39ae11fc16b6 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:51.441907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed14ead-c21b-43de-9b23-39ae11fc16b6 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:51.451285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:51.475642 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959780d9-14bd-4228-b482-1db9f9827a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:51.476284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959780d9-14bd-4228-b482-1db9f9827a95 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:51.476564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959780d9-14bd-4228-b482-1db9f9827a95 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:51.476835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959780d9-14bd-4228-b482-1db9f9827a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:51.541681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959780d9-14bd-4228-b482-1db9f9827a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:51.543703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959780d9-14bd-4228-b482-1db9f9827a95 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:51.637230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 569/1164] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:34:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:34:51.643109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5743dcb-23d8-41df-b7d4-e9bacc8da4fa None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:51.653597 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:51.740016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5743dcb-23d8-41df-b7d4-e9bacc8da4fa None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:51.773072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74bc06-1b91-4ad1-b0ab-80bf54dde919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:51.773861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74bc06-1b91-4ad1-b0ab-80bf54dde919 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:51.774139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74bc06-1b91-4ad1-b0ab-80bf54dde919 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:51.774412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74bc06-1b91-4ad1-b0ab-80bf54dde919 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:51.781609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74bc06-1b91-4ad1-b0ab-80bf54dde919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:51.783040 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74bc06-1b91-4ad1-b0ab-80bf54dde919 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-fe74bc06-1b91-4ad1-b0ab-80bf54dde919 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:34:51.796941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:34:51.802814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:34:51.803962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 596/1165] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Jun 17 08:34:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:34:51.804995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959780d9-14bd-4228-b482-1db9f9827a95 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:51.813974 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:51.899987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959780d9-14bd-4228-b482-1db9f9827a95 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:51.932948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adadb6-8e1d-4b59-9650-a74a628f9459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:51.933597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adadb6-8e1d-4b59-9650-a74a628f9459 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:51.933879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adadb6-8e1d-4b59-9650-a74a628f9459 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:51.934155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adadb6-8e1d-4b59-9650-a74a628f9459 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:51.934866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adadb6-8e1d-4b59-9650-a74a628f9459 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:34:51.935171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adadb6-8e1d-4b59-9650-a74a628f9459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:51.936550 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adadb6-8e1d-4b59-9650-a74a628f9459 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:51.943466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 570/1166] 10.222.0.78 () {56 vars in 1115 bytes} [Fri Jun 17 08:34:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:54.032776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9135f5-0eef-43ac-affb-58d7eafdd8c7 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:54.033330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9135f5-0eef-43ac-affb-58d7eafdd8c7 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:54.033330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9135f5-0eef-43ac-affb-58d7eafdd8c7 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:54.034693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 597/1167] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:54.039783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca44e-9d4f-47ca-911c-df824abfc0b6 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:54.040166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca44e-9d4f-47ca-911c-df824abfc0b6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:54.040340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca44e-9d4f-47ca-911c-df824abfc0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:54.058329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5c3ca44e-9d4f-47ca-911c-df824abfc0b6 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:54.059600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5c3ca44e-9d4f-47ca-911c-df824abfc0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:54.124195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 571/1168] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:54.146728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9135f5-0eef-43ac-affb-58d7eafdd8c7 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:54.213386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:54.246670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9135f5-0eef-43ac-affb-58d7eafdd8c7 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:54.279357 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6fc50-5160-41e6-bbaa-bb5382bdb7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:54.280020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6fc50-5160-41e6-bbaa-bb5382bdb7a3 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:54.280301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6fc50-5160-41e6-bbaa-bb5382bdb7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:54.280578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6fc50-5160-41e6-bbaa-bb5382bdb7a3 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:54.281315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6fc50-5160-41e6-bbaa-bb5382bdb7a3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:54.282676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6fc50-5160-41e6-bbaa-bb5382bdb7a3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:54.365242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 598/1169] 10.222.0.78 () {60 vars in 1138 bytes} [Fri Jun 17 08:34:54 2022] POST /identity/v3/domains => generated 267 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:34:56.493948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8901e-5962-40ad-8abf-de40e1492edc None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:56.494481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8901e-5962-40ad-8abf-de40e1492edc None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:56.494481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8901e-5962-40ad-8abf-de40e1492edc None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:56.495909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 572/1170] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:56.501177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050f8bf-5318-4858-b6d5-82290186a067 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:56.501598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050f8bf-5318-4858-b6d5-82290186a067 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:56.501720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050f8bf-5318-4858-b6d5-82290186a067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:56.518648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-4050f8bf-5318-4858-b6d5-82290186a067 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:56.519848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4050f8bf-5318-4858-b6d5-82290186a067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:56.585788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 599/1171] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:34:56.609058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8901e-5962-40ad-8abf-de40e1492edc None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:56.611923 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:56.708627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8901e-5962-40ad-8abf-de40e1492edc None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:56.740801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59d50e-3b66-4ad9-bd52-d3e7d13f4d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:56.741640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d50e-3b66-4ad9-bd52-d3e7d13f4d32 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:56.741922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d50e-3b66-4ad9-bd52-d3e7d13f4d32 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:56.742197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59d50e-3b66-4ad9-bd52-d3e7d13f4d32 None admin] PATH_INFO: `/v3/domains/4f396f3a422d42ccae0c2db2146efd62` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:56.752809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d50e-3b66-4ad9-bd52-d3e7d13f4d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4f396f3a422d42ccae0c2db2146efd62)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:56.754256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59d50e-3b66-4ad9-bd52-d3e7d13f4d32 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:56.755899 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 573/1172] 10.222.0.78 () {56 vars in 1183 bytes} [Fri Jun 17 08:34:56 2022] GET /identity/v3/domains/4f396f3a422d42ccae0c2db2146efd62 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:56.762330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050f8bf-5318-4858-b6d5-82290186a067 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:56.818027 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:56.858004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050f8bf-5318-4858-b6d5-82290186a067 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:56.890618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012b134-42aa-44ed-bf7b-983c90b2e2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:56.891267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012b134-42aa-44ed-bf7b-983c90b2e2db None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:56.891581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012b134-42aa-44ed-bf7b-983c90b2e2db None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:56.891860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012b134-42aa-44ed-bf7b-983c90b2e2db None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:56.892563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012b134-42aa-44ed-bf7b-983c90b2e2db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:56.893988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012b134-42aa-44ed-bf7b-983c90b2e2db None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:56.967845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 600/1173] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:34:56 2022] POST /identity/v3/projects => generated 361 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:34:59.109338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589aa49-9dfb-4acb-b56a-2c4b0d76b493 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:59.109915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589aa49-9dfb-4acb-b56a-2c4b0d76b493 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:59.109915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589aa49-9dfb-4acb-b56a-2c4b0d76b493 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:59.111256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 574/1174] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:34:59.116857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e7fa-b718-4174-8338-0613ea1e60fd None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:59.117393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e7fa-b718-4174-8338-0613ea1e60fd None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:59.117393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9e7fa-b718-4174-8338-0613ea1e60fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:59.134199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1db9e7fa-b718-4174-8338-0613ea1e60fd None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:34:59.135781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1db9e7fa-b718-4174-8338-0613ea1e60fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:34:59.202319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 601/1175] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:34:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:34:59.227065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589aa49-9dfb-4acb-b56a-2c4b0d76b493 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:59.289612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:59.328224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589aa49-9dfb-4acb-b56a-2c4b0d76b493 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:59.361576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1445911-411f-448c-97eb-384b007f0d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:59.362351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445911-411f-448c-97eb-384b007f0d36 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:59.362629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445911-411f-448c-97eb-384b007f0d36 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:59.362899 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445911-411f-448c-97eb-384b007f0d36 None admin] PATH_INFO: `/v3/domains/4f396f3a422d42ccae0c2db2146efd62` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:59.364062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1445911-411f-448c-97eb-384b007f0d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4f396f3a422d42ccae0c2db2146efd62)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:59.365477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1445911-411f-448c-97eb-384b007f0d36 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:59.367074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 575/1176] 10.222.0.78 () {56 vars in 1183 bytes} [Fri Jun 17 08:34:59 2022] GET /identity/v3/domains/4f396f3a422d42ccae0c2db2146efd62 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:34:59.373022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9e7fa-b718-4174-8338-0613ea1e60fd None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:34:59.413786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:34:59.470512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9e7fa-b718-4174-8338-0613ea1e60fd None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:34:59.504579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb57e3-ed13-44c8-9baf-8fa9c7dbb2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:34:59.505250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb57e3-ed13-44c8-9baf-8fa9c7dbb2fe None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:34:59.505541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb57e3-ed13-44c8-9baf-8fa9c7dbb2fe None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:34:59.505819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb57e3-ed13-44c8-9baf-8fa9c7dbb2fe None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:34:59.506520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb57e3-ed13-44c8-9baf-8fa9c7dbb2fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:34:59.507992 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb57e3-ed13-44c8-9baf-8fa9c7dbb2fe None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:34:59.589464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 602/1177] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:34:59 2022] POST /identity/v3/users => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:35:01.757549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c78b6-b071-487a-80fc-b7eff0e2898b None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:01.758081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c78b6-b071-487a-80fc-b7eff0e2898b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:01.758176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c78b6-b071-487a-80fc-b7eff0e2898b None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:01.759520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 576/1178] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:35:01.765691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24216e5-a237-4ea6-a8eb-36f4e862ea9a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:01.766112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24216e5-a237-4ea6-a8eb-36f4e862ea9a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:01.766247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24216e5-a237-4ea6-a8eb-36f4e862ea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:01.783211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a24216e5-a237-4ea6-a8eb-36f4e862ea9a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:01.784412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a24216e5-a237-4ea6-a8eb-36f4e862ea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:01.850412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 603/1179] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:35:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:35:01.874988 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c78b6-b071-487a-80fc-b7eff0e2898b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:01.973724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c78b6-b071-487a-80fc-b7eff0e2898b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:02.001510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:02.007023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcac89-af0a-4e8f-a3ac-03e0dd6f32f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:02.007892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcac89-af0a-4e8f-a3ac-03e0dd6f32f2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:02.008169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcac89-af0a-4e8f-a3ac-03e0dd6f32f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:02.008445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcac89-af0a-4e8f-a3ac-03e0dd6f32f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:02.019015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcac89-af0a-4e8f-a3ac-03e0dd6f32f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-34bcac89-af0a-4e8f-a3ac-03e0dd6f32f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:35:02.026695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:35:02.027897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:35:02.034032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 577/1180] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:35:02.034922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24216e5-a237-4ea6-a8eb-36f4e862ea9a None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:02.061495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:02.132334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24216e5-a237-4ea6-a8eb-36f4e862ea9a None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:02.167667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb3ea5-6ebd-49d5-81e0-11f6419901c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:02.168335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb3ea5-6ebd-49d5-81e0-11f6419901c7 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:02.168626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb3ea5-6ebd-49d5-81e0-11f6419901c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:02.168901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb3ea5-6ebd-49d5-81e0-11f6419901c7 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:02.169641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb3ea5-6ebd-49d5-81e0-11f6419901c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:02.169949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb3ea5-6ebd-49d5-81e0-11f6419901c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:02.171329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb3ea5-6ebd-49d5-81e0-11f6419901c7 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:02.179780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 604/1181] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:02.186562 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcac89-af0a-4e8f-a3ac-03e0dd6f32f2 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:02.286117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcac89-af0a-4e8f-a3ac-03e0dd6f32f2 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:02.319632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12bf07-71f4-4d3f-ba6b-12aa884cfac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:02.320409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12bf07-71f4-4d3f-ba6b-12aa884cfac7 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:02.320689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12bf07-71f4-4d3f-ba6b-12aa884cfac7 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:02.320964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12bf07-71f4-4d3f-ba6b-12aa884cfac7 None admin] PATH_INFO: `/v3/users/ba922b94ee2b46d0a56d4fe2ad8a009c` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:02.342110 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12bf07-71f4-4d3f-ba6b-12aa884cfac7 None admin] RBAC: Authorizing `identity:get_user(user_id=ba922b94ee2b46d0a56d4fe2ad8a009c)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:02.343595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12bf07-71f4-4d3f-ba6b-12aa884cfac7 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:02.345337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 578/1182] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:35:02 2022] GET /identity/v3/users/ba922b94ee2b46d0a56d4fe2ad8a009c => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:02.351121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb3ea5-6ebd-49d5-81e0-11f6419901c7 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:02.440818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:02.452874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb3ea5-6ebd-49d5-81e0-11f6419901c7 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:02.561134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d656a6-abc0-48cc-99f8-430dc248a3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:02.561690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d656a6-abc0-48cc-99f8-430dc248a3bb None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:02.561971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d656a6-abc0-48cc-99f8-430dc248a3bb None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:02.562247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d656a6-abc0-48cc-99f8-430dc248a3bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:02.629226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d656a6-abc0-48cc-99f8-430dc248a3bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:02.630686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d656a6-abc0-48cc-99f8-430dc248a3bb None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:02.713314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:02.726041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 605/1183] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:35:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:35:02.732624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12bf07-71f4-4d3f-ba6b-12aa884cfac7 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:02.781738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:02.832283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12bf07-71f4-4d3f-ba6b-12aa884cfac7 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:02.865407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d10a-b627-4694-bd17-cd3fa7310154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:02.866256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d10a-b627-4694-bd17-cd3fa7310154 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:02.866532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d10a-b627-4694-bd17-cd3fa7310154 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:02.866799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d10a-b627-4694-bd17-cd3fa7310154 None admin] PATH_INFO: `/v3/projects/4d0829ccecdb48dbaa726b89e2bec443` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:02.867960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649d10a-b627-4694-bd17-cd3fa7310154 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0829ccecdb48dbaa726b89e2bec443)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:02.869386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649d10a-b627-4694-bd17-cd3fa7310154 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:02.871135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 579/1184] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:35:02 2022] GET /identity/v3/projects/4d0829ccecdb48dbaa726b89e2bec443 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:02.877307 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d656a6-abc0-48cc-99f8-430dc248a3bb None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:02.976172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d656a6-abc0-48cc-99f8-430dc248a3bb None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:03.009674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d69a03-4295-4b79-8e14-0828412ee57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:03.010325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69a03-4295-4b79-8e14-0828412ee57e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:03.011152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69a03-4295-4b79-8e14-0828412ee57e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:03.011462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69a03-4295-4b79-8e14-0828412ee57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:03.012295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69a03-4295-4b79-8e14-0828412ee57e None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=4d0829ccecdb48dbaa726b89e2bec443, user.id=ba922b94ee2b46d0a56d4fe2ad8a009c) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:03.012606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69a03-4295-4b79-8e14-0828412ee57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:03.014056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69a03-4295-4b79-8e14-0828412ee57e None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:03.019649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 606/1185] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:35:02 2022] GET /identity/v3/role_assignments?user.id=ba922b94ee2b46d0a56d4fe2ad8a009c&scope.project.id=4d0829ccecdb48dbaa726b89e2bec443&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:05.136891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba012-3349-4e11-928f-9865223dea07 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:05.137459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba012-3349-4e11-928f-9865223dea07 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:05.137459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba012-3349-4e11-928f-9865223dea07 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:05.138818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 580/1186] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:35:05.144124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a4ac-35ae-472b-bbb4-639348a65458 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:05.144552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a4ac-35ae-472b-bbb4-639348a65458 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:05.144664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a4ac-35ae-472b-bbb4-639348a65458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:05.161742 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b666a4ac-35ae-472b-bbb4-639348a65458 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:05.162921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b666a4ac-35ae-472b-bbb4-639348a65458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:05.209336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:05.228528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 607/1187] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:35:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:35:05.250847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ba012-3349-4e11-928f-9865223dea07 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:05.351461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ba012-3349-4e11-928f-9865223dea07 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:05.367914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:05.384753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225a265-0b3c-4edb-86c9-9ca0523fd863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:05.386093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225a265-0b3c-4edb-86c9-9ca0523fd863 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:05.386364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225a265-0b3c-4edb-86c9-9ca0523fd863 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:05.386634 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225a265-0b3c-4edb-86c9-9ca0523fd863 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:05.396615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225a265-0b3c-4edb-86c9-9ca0523fd863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-8225a265-0b3c-4edb-86c9-9ca0523fd863 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:35:05.405445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:35:05.406549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:35:05.417044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 581/1188] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:35:05.417901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666a4ac-35ae-472b-bbb4-639348a65458 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:05.512523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666a4ac-35ae-472b-bbb4-639348a65458 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:05.545509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1548b-fd52-4753-94e3-2d8a27f81b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:05.546161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1548b-fd52-4753-94e3-2d8a27f81b44 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:05.546444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1548b-fd52-4753-94e3-2d8a27f81b44 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:05.546721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1548b-fd52-4753-94e3-2d8a27f81b44 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:05.547482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1548b-fd52-4753-94e3-2d8a27f81b44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:05.547789 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1548b-fd52-4753-94e3-2d8a27f81b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:05.549154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1548b-fd52-4753-94e3-2d8a27f81b44 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:05.557007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 608/1189] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:05.563649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225a265-0b3c-4edb-86c9-9ca0523fd863 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:05.663720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225a265-0b3c-4edb-86c9-9ca0523fd863 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:05.696097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985f3a-3d68-4ecc-bc7c-58ce4b87585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:05.696955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985f3a-3d68-4ecc-bc7c-58ce4b87585c None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:05.697236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985f3a-3d68-4ecc-bc7c-58ce4b87585c None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:05.697505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985f3a-3d68-4ecc-bc7c-58ce4b87585c None admin] PATH_INFO: `/v3/users/ba922b94ee2b46d0a56d4fe2ad8a009c` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:05.698995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17985f3a-3d68-4ecc-bc7c-58ce4b87585c None admin] RBAC: Authorizing `identity:get_user(user_id=ba922b94ee2b46d0a56d4fe2ad8a009c)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:05.700577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17985f3a-3d68-4ecc-bc7c-58ce4b87585c None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:05.702199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 582/1190] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:35:05 2022] GET /identity/v3/users/ba922b94ee2b46d0a56d4fe2ad8a009c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:05.707952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1548b-fd52-4753-94e3-2d8a27f81b44 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:05.752938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:05.806409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1548b-fd52-4753-94e3-2d8a27f81b44 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:05.839202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc54a0-15c2-4c49-a6f0-046791a51ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:05.840163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc54a0-15c2-4c49-a6f0-046791a51ae1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:05.840446 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc54a0-15c2-4c49-a6f0-046791a51ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:05.840723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc54a0-15c2-4c49-a6f0-046791a51ae1 None admin] PATH_INFO: `/v3/projects/4d0829ccecdb48dbaa726b89e2bec443` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:05.841899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc54a0-15c2-4c49-a6f0-046791a51ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0829ccecdb48dbaa726b89e2bec443)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:05.843363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc54a0-15c2-4c49-a6f0-046791a51ae1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:05.845065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 609/1191] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:35:05 2022] GET /identity/v3/projects/4d0829ccecdb48dbaa726b89e2bec443 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:05.851127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985f3a-3d68-4ecc-bc7c-58ce4b87585c None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:05.896685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:05.950268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985f3a-3d68-4ecc-bc7c-58ce4b87585c None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:05.982679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5e359-4181-41bb-b178-6f3c7b9a0352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:05.983592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e359-4181-41bb-b178-6f3c7b9a0352 None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:05.983874 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e359-4181-41bb-b178-6f3c7b9a0352 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:05.984149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e359-4181-41bb-b178-6f3c7b9a0352 None admin] PATH_INFO: `/v3/projects/4d0829ccecdb48dbaa726b89e2bec443/users/ba922b94ee2b46d0a56d4fe2ad8a009c/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:05.986083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5e359-4181-41bb-b178-6f3c7b9a0352 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d0829ccecdb48dbaa726b89e2bec443, user_id=ba922b94ee2b46d0a56d4fe2ad8a009c, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:05.987542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5e359-4181-41bb-b178-6f3c7b9a0352 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:06.084870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 583/1192] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:35:05 2022] PUT /identity/v3/projects/4d0829ccecdb48dbaa726b89e2bec443/users/ba922b94ee2b46d0a56d4fe2ad8a009c/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:35:08.203201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb723956-0b95-4979-9b10-b2d794f77e16 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:08.203871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb723956-0b95-4979-9b10-b2d794f77e16 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:08.203871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb723956-0b95-4979-9b10-b2d794f77e16 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:08.205144 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 610/1193] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:35:08.210380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81a0b6-469f-451d-a653-aecb39484488 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:08.210802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81a0b6-469f-451d-a653-aecb39484488 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:08.210948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81a0b6-469f-451d-a653-aecb39484488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:08.228145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2f81a0b6-469f-451d-a653-aecb39484488 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:35:08.229364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2f81a0b6-469f-451d-a653-aecb39484488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:35:08.297217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 584/1194] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:35:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:35:08.320462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb723956-0b95-4979-9b10-b2d794f77e16 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:08.422460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb723956-0b95-4979-9b10-b2d794f77e16 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:08.435582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:08.457394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca8ea7-94e8-42c2-90be-45006df8dd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:08.458118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca8ea7-94e8-42c2-90be-45006df8dd11 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:08.458399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca8ea7-94e8-42c2-90be-45006df8dd11 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:08.458673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca8ea7-94e8-42c2-90be-45006df8dd11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:08.470126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca8ea7-94e8-42c2-90be-45006df8dd11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-d3ca8ea7-94e8-42c2-90be-45006df8dd11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:35:08.477754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:35:08.478876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:35:08.480325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 611/1195] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:35:08.485068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81a0b6-469f-451d-a653-aecb39484488 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:08.520829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:08.586830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81a0b6-469f-451d-a653-aecb39484488 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:08.620491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78691-b2fd-441d-831b-ff301999b890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:08.621158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78691-b2fd-441d-831b-ff301999b890 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:08.621438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78691-b2fd-441d-831b-ff301999b890 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:08.621709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78691-b2fd-441d-831b-ff301999b890 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:08.622449 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78691-b2fd-441d-831b-ff301999b890 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:08.622755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78691-b2fd-441d-831b-ff301999b890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:08.624155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78691-b2fd-441d-831b-ff301999b890 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:08.633058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 585/1196] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:35:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:08.639700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca8ea7-94e8-42c2-90be-45006df8dd11 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:08.738819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca8ea7-94e8-42c2-90be-45006df8dd11 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:08.772717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88453913-0ea7-4b20-a00b-5f698c2d0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:08.773574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88453913-0ea7-4b20-a00b-5f698c2d0e68 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:08.773856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88453913-0ea7-4b20-a00b-5f698c2d0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:08.774131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88453913-0ea7-4b20-a00b-5f698c2d0e68 None admin] PATH_INFO: `/v3/users/ba922b94ee2b46d0a56d4fe2ad8a009c` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:08.775309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88453913-0ea7-4b20-a00b-5f698c2d0e68 None admin] RBAC: Authorizing `identity:get_user(user_id=ba922b94ee2b46d0a56d4fe2ad8a009c)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:08.777069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88453913-0ea7-4b20-a00b-5f698c2d0e68 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:08.778690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 612/1197] 10.222.0.78 () {56 vars in 1177 bytes} [Fri Jun 17 08:35:08 2022] GET /identity/v3/users/ba922b94ee2b46d0a56d4fe2ad8a009c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:08.784439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78691-b2fd-441d-831b-ff301999b890 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:08.879304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:08.885136 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78691-b2fd-441d-831b-ff301999b890 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:08.923681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c120f8-f1b5-42ec-8933-df2ec3991ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:08.924335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c120f8-f1b5-42ec-8933-df2ec3991ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:08.924617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c120f8-f1b5-42ec-8933-df2ec3991ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:08.924894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c120f8-f1b5-42ec-8933-df2ec3991ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:08.992787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c120f8-f1b5-42ec-8933-df2ec3991ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:08.994163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c120f8-f1b5-42ec-8933-df2ec3991ea9 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:09.092300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:09.098769 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 586/1198] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:35:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:35:09.105150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88453913-0ea7-4b20-a00b-5f698c2d0e68 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:09.147934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:09.207986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88453913-0ea7-4b20-a00b-5f698c2d0e68 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:09.241997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b181cf0-5e4e-4e31-b674-6f854509b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:09.242911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181cf0-5e4e-4e31-b674-6f854509b79a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:09.243146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181cf0-5e4e-4e31-b674-6f854509b79a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:09.243454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181cf0-5e4e-4e31-b674-6f854509b79a None admin] PATH_INFO: `/v3/projects/4d0829ccecdb48dbaa726b89e2bec443` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:09.244695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b181cf0-5e4e-4e31-b674-6f854509b79a None admin] RBAC: Authorizing `identity:get_project(project_id=4d0829ccecdb48dbaa726b89e2bec443)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:09.246744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b181cf0-5e4e-4e31-b674-6f854509b79a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:09.248479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 613/1199] 10.222.0.78 () {56 vars in 1186 bytes} [Fri Jun 17 08:35:09 2022] GET /identity/v3/projects/4d0829ccecdb48dbaa726b89e2bec443 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:09.254763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c120f8-f1b5-42ec-8933-df2ec3991ea9 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:35:09.359104 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c120f8-f1b5-42ec-8933-df2ec3991ea9 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:35:09.391946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf579ec7-ec5f-46db-9213-8f054165d932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:35:09.392604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf579ec7-ec5f-46db-9213-8f054165d932 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:35:09.392881 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf579ec7-ec5f-46db-9213-8f054165d932 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:35:09.393155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf579ec7-ec5f-46db-9213-8f054165d932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:35:09.393973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf579ec7-ec5f-46db-9213-8f054165d932 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=4d0829ccecdb48dbaa726b89e2bec443, user.id=ba922b94ee2b46d0a56d4fe2ad8a009c) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:35:09.394287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf579ec7-ec5f-46db-9213-8f054165d932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:35:09.395736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf579ec7-ec5f-46db-9213-8f054165d932 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:35:09.402027 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 587/1200] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:35:09 2022] GET /identity/v3/role_assignments?user.id=ba922b94ee2b46d0a56d4fe2ad8a009c&scope.project.id=4d0829ccecdb48dbaa726b89e2bec443&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:35:19.237346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=46 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:35:19.398829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=70 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:22.479247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c869c-b7ca-446f-bbb1-77aa83c9bcf1 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:22.479811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c869c-b7ca-446f-bbb1-77aa83c9bcf1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:22.479811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c869c-b7ca-446f-bbb1-77aa83c9bcf1 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:22.481221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 614/1201] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:22.487070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406317bf-c319-48b9-84bb-8f3be007804a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:22.492988 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406317bf-c319-48b9-84bb-8f3be007804a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:22.492988 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406317bf-c319-48b9-84bb-8f3be007804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:22.505672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-406317bf-c319-48b9-84bb-8f3be007804a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:22.506909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-406317bf-c319-48b9-84bb-8f3be007804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:22.574577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 588/1202] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:36:22.599467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c869c-b7ca-446f-bbb1-77aa83c9bcf1 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:22.699573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c869c-b7ca-446f-bbb1-77aa83c9bcf1 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:22.732515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd841b-3d74-4cb2-a312-cae2ef9f5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:22.734121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd841b-3d74-4cb2-a312-cae2ef9f5c08 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:22.734403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd841b-3d74-4cb2-a312-cae2ef9f5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:22.734679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd841b-3d74-4cb2-a312-cae2ef9f5c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:22.744712 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd841b-3d74-4cb2-a312-cae2ef9f5c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:22.746147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd841b-3d74-4cb2-a312-cae2ef9f5c08 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-addd841b-3d74-4cb2-a312-cae2ef9f5c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:22.763648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:22.764807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:22.770371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:22.770371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:22.770371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:22.770371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:22.770371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 615/1203] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:36:22.770887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406317bf-c319-48b9-84bb-8f3be007804a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:22.870442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406317bf-c319-48b9-84bb-8f3be007804a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:22.899286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:22.905099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ea816-f8e3-4567-b94b-4c80548a8dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:22.906244 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea816-f8e3-4567-b94b-4c80548a8dad None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:22.906526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea816-f8e3-4567-b94b-4c80548a8dad None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:22.906799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea816-f8e3-4567-b94b-4c80548a8dad None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:22.907622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ea816-f8e3-4567-b94b-4c80548a8dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:22.907928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ea816-f8e3-4567-b94b-4c80548a8dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:22.909428 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ea816-f8e3-4567-b94b-4c80548a8dad None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:22.920361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 589/1204] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:22.926922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd841b-3d74-4cb2-a312-cae2ef9f5c08 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:22.980850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:23.026351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd841b-3d74-4cb2-a312-cae2ef9f5c08 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:23.060971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd1df0-cfce-4a9f-9fa8-c1c86d4000c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:23.061682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd1df0-cfce-4a9f-9fa8-c1c86d4000c2 None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:23.061963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd1df0-cfce-4a9f-9fa8-c1c86d4000c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:23.062242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd1df0-cfce-4a9f-9fa8-c1c86d4000c2 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:23.063000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd1df0-cfce-4a9f-9fa8-c1c86d4000c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:23.064498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd1df0-cfce-4a9f-9fa8-c1c86d4000c2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:23.171872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 616/1205] 10.222.0.78 () {60 vars in 1132 bytes} [Fri Jun 17 08:36:22 2022] POST /identity/v3/users => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:25.290636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a27e7-caac-4849-b4f3-7d6e80dec973 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:25.291221 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a27e7-caac-4849-b4f3-7d6e80dec973 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:25.291221 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a27e7-caac-4849-b4f3-7d6e80dec973 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:25.292573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 590/1206] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:25.298266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c895321-df9c-4452-81d1-ed2f837e0e21 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:25.298667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c895321-df9c-4452-81d1-ed2f837e0e21 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:25.298827 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c895321-df9c-4452-81d1-ed2f837e0e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:25.315648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3c895321-df9c-4452-81d1-ed2f837e0e21 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:25.316815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3c895321-df9c-4452-81d1-ed2f837e0e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:25.381448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 617/1207] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:36:25.404322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a27e7-caac-4849-b4f3-7d6e80dec973 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:25.507264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a27e7-caac-4849-b4f3-7d6e80dec973 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:25.540277 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03557d7d-717f-468a-a107-3e19c637590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:25.541122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03557d7d-717f-468a-a107-3e19c637590d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:25.541346 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03557d7d-717f-468a-a107-3e19c637590d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:25.541615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03557d7d-717f-468a-a107-3e19c637590d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:25.552161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03557d7d-717f-468a-a107-3e19c637590d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-03557d7d-717f-468a-a107-3e19c637590d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:36:25.559801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:25.560976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:25.562712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 591/1208] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:36:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:25.567831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c895321-df9c-4452-81d1-ed2f837e0e21 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:25.612221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:25.672596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c895321-df9c-4452-81d1-ed2f837e0e21 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:25.706338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9a70-272f-4351-8b5f-3956856935e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:25.706991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9a70-272f-4351-8b5f-3956856935e5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:25.707273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9a70-272f-4351-8b5f-3956856935e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:25.707576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9a70-272f-4351-8b5f-3956856935e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:25.708310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba9a70-272f-4351-8b5f-3956856935e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:25.708613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba9a70-272f-4351-8b5f-3956856935e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:25.709973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba9a70-272f-4351-8b5f-3956856935e5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:25.718052 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 618/1209] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:36:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:25.724380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03557d7d-717f-468a-a107-3e19c637590d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:25.775476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:25.828341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03557d7d-717f-468a-a107-3e19c637590d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:25.866087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bb349-7f1b-470f-a7a5-cc1366cbcde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:25.867025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bb349-7f1b-470f-a7a5-cc1366cbcde1 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:25.867423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bb349-7f1b-470f-a7a5-cc1366cbcde1 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:25.867840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bb349-7f1b-470f-a7a5-cc1366cbcde1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:25.881492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bb349-7f1b-470f-a7a5-cc1366cbcde1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:25.888033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bb349-7f1b-470f-a7a5-cc1366cbcde1 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-c15bb349-7f1b-470f-a7a5-cc1366cbcde1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:25.904560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:25.905622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:25.906759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:25.906759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:25.906759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:25.906759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:25.906759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 592/1210] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:25.912888 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9a70-272f-4351-8b5f-3956856935e5 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:26.010926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:26.013832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9a70-272f-4351-8b5f-3956856935e5 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:26.048154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d980c-75cd-4a75-8463-f20895db30bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:26.048810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d980c-75cd-4a75-8463-f20895db30bf None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:26.049095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d980c-75cd-4a75-8463-f20895db30bf None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:26.049371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d980c-75cd-4a75-8463-f20895db30bf None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:26.050094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d980c-75cd-4a75-8463-f20895db30bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:26.050395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d980c-75cd-4a75-8463-f20895db30bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:26.051810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d980c-75cd-4a75-8463-f20895db30bf None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:26.065100 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 619/1211] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:36:26.071445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bb349-7f1b-470f-a7a5-cc1366cbcde1 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:26.170269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bb349-7f1b-470f-a7a5-cc1366cbcde1 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:26.172773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:26.214911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96990b5-1d82-476c-844a-04683292fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:26.215738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96990b5-1d82-476c-844a-04683292fab4 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:26.216021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96990b5-1d82-476c-844a-04683292fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:26.216297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96990b5-1d82-476c-844a-04683292fab4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:26.223264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96990b5-1d82-476c-844a-04683292fab4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:26.225750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96990b5-1d82-476c-844a-04683292fab4 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-e96990b5-1d82-476c-844a-04683292fab4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:36:26.239456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:26.240386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:26.241505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 593/1212] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:26.246542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d980c-75cd-4a75-8463-f20895db30bf None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:26.350081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d980c-75cd-4a75-8463-f20895db30bf None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:26.385132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e2975-06e1-4b41-aded-2af48ac93e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:26.385807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e2975-06e1-4b41-aded-2af48ac93e5c None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:26.386088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e2975-06e1-4b41-aded-2af48ac93e5c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:26.386422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e2975-06e1-4b41-aded-2af48ac93e5c None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:26.387251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e2975-06e1-4b41-aded-2af48ac93e5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:26.387588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e2975-06e1-4b41-aded-2af48ac93e5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:26.389019 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e2975-06e1-4b41-aded-2af48ac93e5c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:26.407107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 620/1213] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Jun 17 08:36:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:26.412792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96990b5-1d82-476c-844a-04683292fab4 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:26.519799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96990b5-1d82-476c-844a-04683292fab4 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:26.553709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3d569-2adf-4d02-8eb7-67dd135aa34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:26.554350 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3d569-2adf-4d02-8eb7-67dd135aa34b None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:26.554627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3d569-2adf-4d02-8eb7-67dd135aa34b None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:26.554904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3d569-2adf-4d02-8eb7-67dd135aa34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:26.584494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:26.623108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3d569-2adf-4d02-8eb7-67dd135aa34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:26.624737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3d569-2adf-4d02-8eb7-67dd135aa34b None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:26.722830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 594/1214] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:36:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:36:26.728605 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e2975-06e1-4b41-aded-2af48ac93e5c None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:26.748222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:26.828345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e2975-06e1-4b41-aded-2af48ac93e5c None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:26.862434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cce65-b4d3-4c6e-8d9c-a00071095248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:26.863224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cce65-b4d3-4c6e-8d9c-a00071095248 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:26.863536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cce65-b4d3-4c6e-8d9c-a00071095248 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:26.863812 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cce65-b4d3-4c6e-8d9c-a00071095248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:26.873613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cce65-b4d3-4c6e-8d9c-a00071095248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:26.875472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cce65-b4d3-4c6e-8d9c-a00071095248 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-960cce65-b4d3-4c6e-8d9c-a00071095248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:26.893054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:26.895930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:26.896818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:26.896818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:26.896818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:26.896818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:26.896818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 621/1215] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:26.900585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3d569-2adf-4d02-8eb7-67dd135aa34b None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:26.962121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:27.000005 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3d569-2adf-4d02-8eb7-67dd135aa34b None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:27.033637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96053a4-8085-4104-961e-237d414a74c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:27.034289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96053a4-8085-4104-961e-237d414a74c7 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:27.034571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96053a4-8085-4104-961e-237d414a74c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:27.034846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96053a4-8085-4104-961e-237d414a74c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:27.035578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96053a4-8085-4104-961e-237d414a74c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:27.035883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96053a4-8085-4104-961e-237d414a74c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:27.037244 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96053a4-8085-4104-961e-237d414a74c7 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:27.048768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 595/1216] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:27.054413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cce65-b4d3-4c6e-8d9c-a00071095248 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:27.126894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:27.160056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cce65-b4d3-4c6e-8d9c-a00071095248 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:27.193417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eccc1-efc7-48da-b81f-524429fc99bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:27.194205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eccc1-efc7-48da-b81f-524429fc99bd None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:27.194482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eccc1-efc7-48da-b81f-524429fc99bd None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:27.194754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eccc1-efc7-48da-b81f-524429fc99bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:27.201385 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557eccc1-efc7-48da-b81f-524429fc99bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:27.206240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557eccc1-efc7-48da-b81f-524429fc99bd None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-557eccc1-efc7-48da-b81f-524429fc99bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:36:27.217421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:27.221758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:27.223867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:36:27.223867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:36:27.223867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:36:27.223867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:36:27.223867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:36:27.223867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:36:27.223867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:27.223867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:27.223867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 622/1217] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:27.227129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96053a4-8085-4104-961e-237d414a74c7 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:27.329088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96053a4-8085-4104-961e-237d414a74c7 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:27.350904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:27.362156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c579a65-4aeb-43a4-b17c-849a53622b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:27.362812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579a65-4aeb-43a4-b17c-849a53622b32 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:27.363092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579a65-4aeb-43a4-b17c-849a53622b32 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:27.363387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579a65-4aeb-43a4-b17c-849a53622b32 None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:27.364165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c579a65-4aeb-43a4-b17c-849a53622b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:27.364469 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c579a65-4aeb-43a4-b17c-849a53622b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:27.365885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c579a65-4aeb-43a4-b17c-849a53622b32 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:27.377647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 596/1218] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:27.383863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eccc1-efc7-48da-b81f-524429fc99bd None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:27.488473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eccc1-efc7-48da-b81f-524429fc99bd None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:27.518343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:27.524308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325b833-b1f9-4230-a16c-3e81c3cb8cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:27.525075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b833-b1f9-4230-a16c-3e81c3cb8cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:27.525359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b833-b1f9-4230-a16c-3e81c3cb8cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:27.525648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b833-b1f9-4230-a16c-3e81c3cb8cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:27.526477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325b833-b1f9-4230-a16c-3e81c3cb8cf0 None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=f79f43c31f5346d5b1e6ae6ff8c511a8) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:27.526791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325b833-b1f9-4230-a16c-3e81c3cb8cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:27.528532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325b833-b1f9-4230-a16c-3e81c3cb8cf0 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:27.534392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 623/1219] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:36:27 2022] GET /identity/v3/role_assignments?user.id=f79f43c31f5346d5b1e6ae6ff8c511a8&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:29.614308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ae00c-6917-44d9-a0e5-1e5ef2b68e5b None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:29.614834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ae00c-6917-44d9-a0e5-1e5ef2b68e5b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:29.614834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ae00c-6917-44d9-a0e5-1e5ef2b68e5b None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:29.616243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 597/1220] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:29.621510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff9c2f-a593-430d-8b08-3cc00257ebe8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:29.621927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff9c2f-a593-430d-8b08-3cc00257ebe8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:29.622059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff9c2f-a593-430d-8b08-3cc00257ebe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:29.639415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-faff9c2f-a593-430d-8b08-3cc00257ebe8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:29.645069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-faff9c2f-a593-430d-8b08-3cc00257ebe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:29.708813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 624/1221] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:36:29.730995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ae00c-6917-44d9-a0e5-1e5ef2b68e5b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:29.835148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ae00c-6917-44d9-a0e5-1e5ef2b68e5b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:29.870914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cd467-05ed-4f03-8af9-b53db3fc9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:29.871778 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cd467-05ed-4f03-8af9-b53db3fc9f17 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:29.872064 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cd467-05ed-4f03-8af9-b53db3fc9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:29.872342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cd467-05ed-4f03-8af9-b53db3fc9f17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:29.883294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cd467-05ed-4f03-8af9-b53db3fc9f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-e68cd467-05ed-4f03-8af9-b53db3fc9f17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:36:29.892166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:29.893266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:29.894162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 598/1222] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:36:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:29.899776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff9c2f-a593-430d-8b08-3cc00257ebe8 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:29.998131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff9c2f-a593-430d-8b08-3cc00257ebe8 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:30.021398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:30.032639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7961c0-c2de-49e4-bcd5-726865161a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:30.033296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7961c0-c2de-49e4-bcd5-726865161a75 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:30.033577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7961c0-c2de-49e4-bcd5-726865161a75 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:30.033849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7961c0-c2de-49e4-bcd5-726865161a75 None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:30.034578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7961c0-c2de-49e4-bcd5-726865161a75 None admin] RBAC: Adding query filter params (name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:30.034879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7961c0-c2de-49e4-bcd5-726865161a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:30.036291 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7961c0-c2de-49e4-bcd5-726865161a75 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:30.044101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 625/1223] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:36:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:30.049966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cd467-05ed-4f03-8af9-b53db3fc9f17 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:30.093914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:30.149861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cd467-05ed-4f03-8af9-b53db3fc9f17 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:30.183366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e53e8a-742e-49ad-87ec-f8c1b0c4b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:30.184174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e53e8a-742e-49ad-87ec-f8c1b0c4b6d2 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:30.184453 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e53e8a-742e-49ad-87ec-f8c1b0c4b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:30.184727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e53e8a-742e-49ad-87ec-f8c1b0c4b6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:30.195720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e53e8a-742e-49ad-87ec-f8c1b0c4b6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:30.197159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e53e8a-742e-49ad-87ec-f8c1b0c4b6d2 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-91e53e8a-742e-49ad-87ec-f8c1b0c4b6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:30.214663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:30.215720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:30.216992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:30.216992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:30.216992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:30.216992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:30.216992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 599/1224] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:30.221899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7961c0-c2de-49e4-bcd5-726865161a75 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:30.323013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7961c0-c2de-49e4-bcd5-726865161a75 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:30.358130 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac83c9-3a83-4a26-93e5-148353f147e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:30.359200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac83c9-3a83-4a26-93e5-148353f147e0 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:30.359534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac83c9-3a83-4a26-93e5-148353f147e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:30.359841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac83c9-3a83-4a26-93e5-148353f147e0 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:30.360664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac83c9-3a83-4a26-93e5-148353f147e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:30.360999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac83c9-3a83-4a26-93e5-148353f147e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:30.362440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac83c9-3a83-4a26-93e5-148353f147e0 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:30.375030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 626/1225] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:30.380726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e53e8a-742e-49ad-87ec-f8c1b0c4b6d2 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:30.476386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:30.483017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e53e8a-742e-49ad-87ec-f8c1b0c4b6d2 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:30.517664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32396d1-4651-4ee3-9c75-290c3e2acd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:30.518462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32396d1-4651-4ee3-9c75-290c3e2acd92 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:30.518757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32396d1-4651-4ee3-9c75-290c3e2acd92 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:30.519014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32396d1-4651-4ee3-9c75-290c3e2acd92 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:30.525944 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32396d1-4651-4ee3-9c75-290c3e2acd92 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:30.527428 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32396d1-4651-4ee3-9c75-290c3e2acd92 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-f32396d1-4651-4ee3-9c75-290c3e2acd92 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:36:30.543721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:30.544692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:30.546286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 600/1226] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:30.551312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac83c9-3a83-4a26-93e5-148353f147e0 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:30.598022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:30.649956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac83c9-3a83-4a26-93e5-148353f147e0 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:30.683134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57b84a-d0a9-4d20-a67a-c5fa56ae96c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:30.683836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57b84a-d0a9-4d20-a67a-c5fa56ae96c4 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:30.684117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57b84a-d0a9-4d20-a67a-c5fa56ae96c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:30.684389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57b84a-d0a9-4d20-a67a-c5fa56ae96c4 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:30.685325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57b84a-d0a9-4d20-a67a-c5fa56ae96c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:30.685632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57b84a-d0a9-4d20-a67a-c5fa56ae96c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:30.687807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57b84a-d0a9-4d20-a67a-c5fa56ae96c4 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:30.707494 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 627/1227] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Jun 17 08:36:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:30.713046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32396d1-4651-4ee3-9c75-290c3e2acd92 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:30.812372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32396d1-4651-4ee3-9c75-290c3e2acd92 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:30.851155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4301-2ddb-474a-94c8-5a17daa21323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:30.851897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4301-2ddb-474a-94c8-5a17daa21323 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:30.852177 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4301-2ddb-474a-94c8-5a17daa21323 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:30.852467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4301-2ddb-474a-94c8-5a17daa21323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:30.863321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b4301-2ddb-474a-94c8-5a17daa21323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:30.868003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b4301-2ddb-474a-94c8-5a17daa21323 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-c13b4301-2ddb-474a-94c8-5a17daa21323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:30.882876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:30.884007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:30.885117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:30.885117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:30.885117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:30.885117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:30.885117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 601/1228] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:30.889894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57b84a-d0a9-4d20-a67a-c5fa56ae96c4 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:30.994018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57b84a-d0a9-4d20-a67a-c5fa56ae96c4 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:30.996322 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:31.026832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1980d-31a7-4043-8358-05006cfe18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:31.027526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1980d-31a7-4043-8358-05006cfe18d3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:31.027806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1980d-31a7-4043-8358-05006cfe18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:31.028081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1980d-31a7-4043-8358-05006cfe18d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:31.028792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1980d-31a7-4043-8358-05006cfe18d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:31.029096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1980d-31a7-4043-8358-05006cfe18d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:31.030986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1980d-31a7-4043-8358-05006cfe18d3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:31.045697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 628/1229] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:31.048905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4301-2ddb-474a-94c8-5a17daa21323 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:31.058687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:31.151596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4301-2ddb-474a-94c8-5a17daa21323 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:31.186156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac3938-ea94-404a-8aac-6799bccfcce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:31.187046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac3938-ea94-404a-8aac-6799bccfcce7 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:31.187332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac3938-ea94-404a-8aac-6799bccfcce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:31.187757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac3938-ea94-404a-8aac-6799bccfcce7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:31.194398 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac3938-ea94-404a-8aac-6799bccfcce7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:31.195911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac3938-ea94-404a-8aac-6799bccfcce7 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-c2ac3938-ea94-404a-8aac-6799bccfcce7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:36:31.210304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:31.211386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:31.212683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:36:31.212683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:36:31.212683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:36:31.212683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:36:31.212683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:36:31.212683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:36:31.212683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:31.212683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:31.212683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 602/1230] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:31.217332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1980d-31a7-4043-8358-05006cfe18d3 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:31.315964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1980d-31a7-4043-8358-05006cfe18d3 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:31.349256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fd291-3bb1-4c50-8ec9-3a1328fbbb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:31.349902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fd291-3bb1-4c50-8ec9-3a1328fbbb6a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:31.350183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fd291-3bb1-4c50-8ec9-3a1328fbbb6a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:31.350457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fd291-3bb1-4c50-8ec9-3a1328fbbb6a None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:31.351228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fd291-3bb1-4c50-8ec9-3a1328fbbb6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:31.351557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fd291-3bb1-4c50-8ec9-3a1328fbbb6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:31.352977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fd291-3bb1-4c50-8ec9-3a1328fbbb6a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:31.364954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 629/1231] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:31.371026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac3938-ea94-404a-8aac-6799bccfcce7 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:31.435713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:31.471858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac3938-ea94-404a-8aac-6799bccfcce7 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:31.506365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc3b14-bcd7-4d7e-8380-5ec5c5021d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:31.507241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3b14-bcd7-4d7e-8380-5ec5c5021d95 None admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:31.507548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3b14-bcd7-4d7e-8380-5ec5c5021d95 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:31.507824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3b14-bcd7-4d7e-8380-5ec5c5021d95 None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/f79f43c31f5346d5b1e6ae6ff8c511a8/roles/72f436fe8f3041eea65efc9ea7545683` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:31.522803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc3b14-bcd7-4d7e-8380-5ec5c5021d95 None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=f79f43c31f5346d5b1e6ae6ff8c511a8, role_id=72f436fe8f3041eea65efc9ea7545683)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:31.524329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc3b14-bcd7-4d7e-8380-5ec5c5021d95 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:31.605918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 603/1232] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:36:31 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/f79f43c31f5346d5b1e6ae6ff8c511a8/roles/72f436fe8f3041eea65efc9ea7545683 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:33.762713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3bb7-456f-4c9e-8fea-57534b35899d None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:33.763246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3bb7-456f-4c9e-8fea-57534b35899d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:33.763246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3bb7-456f-4c9e-8fea-57534b35899d None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:33.764875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 630/1233] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:33.769998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c302-cc0b-47cb-8016-3d72f38f2cf3 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:33.770423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c302-cc0b-47cb-8016-3d72f38f2cf3 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:33.770525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c302-cc0b-47cb-8016-3d72f38f2cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:33.788679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d744c302-cc0b-47cb-8016-3d72f38f2cf3 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:33.789877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d744c302-cc0b-47cb-8016-3d72f38f2cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:33.857024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 604/1234] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:36:33.881163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab3bb7-456f-4c9e-8fea-57534b35899d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:33.908552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:33.985218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab3bb7-456f-4c9e-8fea-57534b35899d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:34.019678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc89fd9-1f87-44b1-af59-c5c16e20cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:34.020401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc89fd9-1f87-44b1-af59-c5c16e20cd3e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:34.020680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc89fd9-1f87-44b1-af59-c5c16e20cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:34.020953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc89fd9-1f87-44b1-af59-c5c16e20cd3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:34.031579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc89fd9-1f87-44b1-af59-c5c16e20cd3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-9fc89fd9-1f87-44b1-af59-c5c16e20cd3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:36:34.039287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:34.040473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:34.041693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 631/1235] 10.222.0.78 () {56 vars in 1102 bytes} [Fri Jun 17 08:36:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:34.047103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744c302-cc0b-47cb-8016-3d72f38f2cf3 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:34.093693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:34.146153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744c302-cc0b-47cb-8016-3d72f38f2cf3 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:34.179902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d29c3-64b0-44bc-87f1-6ca488645807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:34.180557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d29c3-64b0-44bc-87f1-6ca488645807 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:34.180842 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d29c3-64b0-44bc-87f1-6ca488645807 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:34.181115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d29c3-64b0-44bc-87f1-6ca488645807 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:34.181847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d29c3-64b0-44bc-87f1-6ca488645807 None admin] RBAC: Adding query filter params (name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:34.182151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d29c3-64b0-44bc-87f1-6ca488645807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:34.183544 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d29c3-64b0-44bc-87f1-6ca488645807 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:34.192567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 605/1236] 10.222.0.78 () {56 vars in 1103 bytes} [Fri Jun 17 08:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:36:34.198503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc89fd9-1f87-44b1-af59-c5c16e20cd3e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:34.287008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:34.303356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc89fd9-1f87-44b1-af59-c5c16e20cd3e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:34.337097 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8b785-6462-4f6c-9e12-13f54a867f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:34.337881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8b785-6462-4f6c-9e12-13f54a867f00 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:34.338169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8b785-6462-4f6c-9e12-13f54a867f00 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:34.338452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8b785-6462-4f6c-9e12-13f54a867f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:34.349288 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8b785-6462-4f6c-9e12-13f54a867f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:34.350736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8b785-6462-4f6c-9e12-13f54a867f00 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ede8b785-6462-4f6c-9e12-13f54a867f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:34.368556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:34.369819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:34.370892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:34.370892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:34.370892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:34.370892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:34.370892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 632/1237] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:34.376054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d29c3-64b0-44bc-87f1-6ca488645807 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:34.475521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d29c3-64b0-44bc-87f1-6ca488645807 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:34.486513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:34.510978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703355c3-1c20-49ed-bbec-88058bdc2297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:34.511667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703355c3-1c20-49ed-bbec-88058bdc2297 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:34.511946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703355c3-1c20-49ed-bbec-88058bdc2297 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:34.512220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703355c3-1c20-49ed-bbec-88058bdc2297 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:34.512931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703355c3-1c20-49ed-bbec-88058bdc2297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:34.513232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703355c3-1c20-49ed-bbec-88058bdc2297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:34.515131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703355c3-1c20-49ed-bbec-88058bdc2297 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:34.527049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 606/1238] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:34.533848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8b785-6462-4f6c-9e12-13f54a867f00 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:34.637245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8b785-6462-4f6c-9e12-13f54a867f00 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:34.670445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed0981-3dde-4d70-8d7d-d58c711a8f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:34.671331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0981-3dde-4d70-8d7d-d58c711a8f56 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:34.671645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0981-3dde-4d70-8d7d-d58c711a8f56 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:34.671957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0981-3dde-4d70-8d7d-d58c711a8f56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:34.674586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:34.679044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed0981-3dde-4d70-8d7d-d58c711a8f56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:34.680513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed0981-3dde-4d70-8d7d-d58c711a8f56 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-1eed0981-3dde-4d70-8d7d-d58c711a8f56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:36:34.695660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:34.696813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:34.698228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 633/1239] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:34.703727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703355c3-1c20-49ed-bbec-88058bdc2297 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:34.802068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703355c3-1c20-49ed-bbec-88058bdc2297 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:34.836477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d67e72-0ccb-40e5-bbb9-861ec7ecee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:34.837197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67e72-0ccb-40e5-bbb9-861ec7ecee31 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:34.837423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67e72-0ccb-40e5-bbb9-861ec7ecee31 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:34.837699 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67e72-0ccb-40e5-bbb9-861ec7ecee31 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:34.838525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d67e72-0ccb-40e5-bbb9-861ec7ecee31 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:34.838836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d67e72-0ccb-40e5-bbb9-861ec7ecee31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:34.840280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d67e72-0ccb-40e5-bbb9-861ec7ecee31 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:34.857626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 607/1240] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Jun 17 08:36:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:34.863599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed0981-3dde-4d70-8d7d-d58c711a8f56 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:34.966671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed0981-3dde-4d70-8d7d-d58c711a8f56 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:35.000978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eae9cb-712e-4311-9b4b-cc16fceeed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:35.001616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eae9cb-712e-4311-9b4b-cc16fceeed1c None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:35.001899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eae9cb-712e-4311-9b4b-cc16fceeed1c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:35.002177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eae9cb-712e-4311-9b4b-cc16fceeed1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:35.066877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:35.080389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eae9cb-712e-4311-9b4b-cc16fceeed1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:35.081840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eae9cb-712e-4311-9b4b-cc16fceeed1c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:35.180101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 634/1241] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:36:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:36:35.185870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d67e72-0ccb-40e5-bbb9-861ec7ecee31 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:35.213697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:35.294648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d67e72-0ccb-40e5-bbb9-861ec7ecee31 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:35.331804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685bac3-1ceb-4ad7-9569-0698280d2d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:35.332606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685bac3-1ceb-4ad7-9569-0698280d2d90 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:35.332890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685bac3-1ceb-4ad7-9569-0698280d2d90 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:35.333165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685bac3-1ceb-4ad7-9569-0698280d2d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:35.343506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685bac3-1ceb-4ad7-9569-0698280d2d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:35.344964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685bac3-1ceb-4ad7-9569-0698280d2d90 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-8685bac3-1ceb-4ad7-9569-0698280d2d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:35.362504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:35.363556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:35.364701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:35.364701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:35.364701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:35.364701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:35.364701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 608/1242] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:35.369432 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eae9cb-712e-4311-9b4b-cc16fceeed1c None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:35.466004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:35.473062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eae9cb-712e-4311-9b4b-cc16fceeed1c None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:35.507024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f943f5b-2d27-4288-88cf-53f5d9675c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:35.507777 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943f5b-2d27-4288-88cf-53f5d9675c27 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:35.508168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943f5b-2d27-4288-88cf-53f5d9675c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:35.508509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943f5b-2d27-4288-88cf-53f5d9675c27 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:35.509234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f943f5b-2d27-4288-88cf-53f5d9675c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:35.509538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f943f5b-2d27-4288-88cf-53f5d9675c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:35.510889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f943f5b-2d27-4288-88cf-53f5d9675c27 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:35.522168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 635/1243] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:35.527917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685bac3-1ceb-4ad7-9569-0698280d2d90 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:35.605000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:35.626040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685bac3-1ceb-4ad7-9569-0698280d2d90 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:35.660168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913e974-de29-4543-b8d6-106c20afd028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:35.660940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e974-de29-4543-b8d6-106c20afd028 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:35.661222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e974-de29-4543-b8d6-106c20afd028 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:35.661502 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e974-de29-4543-b8d6-106c20afd028 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:35.667917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913e974-de29-4543-b8d6-106c20afd028 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:35.669341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913e974-de29-4543-b8d6-106c20afd028 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-a913e974-de29-4543-b8d6-106c20afd028 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:36:35.683291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:35.684357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:35.685376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:36:35.685376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:36:35.685376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:36:35.685376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:36:35.685376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:36:35.685376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:36:35.685376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:35.685376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:35.685376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 609/1244] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:35.690520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f943f5b-2d27-4288-88cf-53f5d9675c27 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:35.791970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f943f5b-2d27-4288-88cf-53f5d9675c27 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:35.824838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7b2ac-e17b-4a3d-8da2-08f7c79fb11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:35.825514 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7b2ac-e17b-4a3d-8da2-08f7c79fb11f None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:35.825820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7b2ac-e17b-4a3d-8da2-08f7c79fb11f None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:35.826126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7b2ac-e17b-4a3d-8da2-08f7c79fb11f None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:35.827595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7b2ac-e17b-4a3d-8da2-08f7c79fb11f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:35.827951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7b2ac-e17b-4a3d-8da2-08f7c79fb11f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:35.829333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7b2ac-e17b-4a3d-8da2-08f7c79fb11f None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:35.840926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 636/1245] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:36:35.847631 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913e974-de29-4543-b8d6-106c20afd028 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:35.947256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913e974-de29-4543-b8d6-106c20afd028 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:35.981209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b3131-c418-4c9f-8ee0-b6cb8fa10272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:35.981859 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b3131-c418-4c9f-8ee0-b6cb8fa10272 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:35.982142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b3131-c418-4c9f-8ee0-b6cb8fa10272 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:35.982419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b3131-c418-4c9f-8ee0-b6cb8fa10272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:35.983300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b3131-c418-4c9f-8ee0-b6cb8fa10272 None admin] RBAC: Adding query filter params (role.id=72f436fe8f3041eea65efc9ea7545683, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=f79f43c31f5346d5b1e6ae6ff8c511a8) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:35.983651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b3131-c418-4c9f-8ee0-b6cb8fa10272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:35.985068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b3131-c418-4c9f-8ee0-b6cb8fa10272 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:35.990933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 610/1246] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:36:35 2022] GET /identity/v3/role_assignments?user.id=f79f43c31f5346d5b1e6ae6ff8c511a8&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=72f436fe8f3041eea65efc9ea7545683 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:38.222078 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e31ed1-7849-40af-a529-7f005c4139df None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:38.222660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e31ed1-7849-40af-a529-7f005c4139df None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:38.222660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e31ed1-7849-40af-a529-7f005c4139df None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:38.224007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 637/1247] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:38.229056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72db3-31fc-42c0-8787-394f6fdc50fd None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:38.229463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72db3-31fc-42c0-8787-394f6fdc50fd None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:38.229592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72db3-31fc-42c0-8787-394f6fdc50fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:38.234592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:38.246421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-fcf72db3-31fc-42c0-8787-394f6fdc50fd None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:38.247620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-fcf72db3-31fc-42c0-8787-394f6fdc50fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:38.314564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 611/1248] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:36:38.338722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e31ed1-7849-40af-a529-7f005c4139df None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:38.357152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:38.438429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e31ed1-7849-40af-a529-7f005c4139df None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:38.473345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84021a-8a08-487a-867f-c7ad86a58dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:38.474262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84021a-8a08-487a-867f-c7ad86a58dc2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:38.474262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84021a-8a08-487a-867f-c7ad86a58dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:38.474262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84021a-8a08-487a-867f-c7ad86a58dc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:38.486578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84021a-8a08-487a-867f-c7ad86a58dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-5c84021a-8a08-487a-867f-c7ad86a58dc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:36:38.494970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:38.496065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:38.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 638/1249] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:36:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:38.503039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72db3-31fc-42c0-8787-394f6fdc50fd None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:38.599847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72db3-31fc-42c0-8787-394f6fdc50fd None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:38.630903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:38.635897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcec1e4-a4c7-45db-b5e0-d2715ab7e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:38.636570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcec1e4-a4c7-45db-b5e0-d2715ab7e20d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:38.636855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcec1e4-a4c7-45db-b5e0-d2715ab7e20d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:38.637131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcec1e4-a4c7-45db-b5e0-d2715ab7e20d None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:38.637873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcec1e4-a4c7-45db-b5e0-d2715ab7e20d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:38.638216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcec1e4-a4c7-45db-b5e0-d2715ab7e20d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:38.640406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcec1e4-a4c7-45db-b5e0-d2715ab7e20d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:38.648938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 612/1250] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:38.656333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84021a-8a08-487a-867f-c7ad86a58dc2 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:38.734066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:38.757250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84021a-8a08-487a-867f-c7ad86a58dc2 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:38.791967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40abb71-7b8d-4002-a809-feb5c2d53700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:38.792765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40abb71-7b8d-4002-a809-feb5c2d53700 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:38.793049 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40abb71-7b8d-4002-a809-feb5c2d53700 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:38.793325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40abb71-7b8d-4002-a809-feb5c2d53700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:38.805131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40abb71-7b8d-4002-a809-feb5c2d53700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:38.806599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40abb71-7b8d-4002-a809-feb5c2d53700 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-b40abb71-7b8d-4002-a809-feb5c2d53700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:38.824874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:38.825973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:38.827311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:38.827311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:38.827311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:38.827311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:38.827311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 639/1251] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:36:38.832195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcec1e4-a4c7-45db-b5e0-d2715ab7e20d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:38.933647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcec1e4-a4c7-45db-b5e0-d2715ab7e20d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:38.969117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63412d4b-ad71-4fa2-9085-f19c92e4c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:38.969783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63412d4b-ad71-4fa2-9085-f19c92e4c90a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:38.970063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63412d4b-ad71-4fa2-9085-f19c92e4c90a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:38.970344 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63412d4b-ad71-4fa2-9085-f19c92e4c90a None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:38.971065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63412d4b-ad71-4fa2-9085-f19c92e4c90a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:38.971399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63412d4b-ad71-4fa2-9085-f19c92e4c90a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:38.975692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63412d4b-ad71-4fa2-9085-f19c92e4c90a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:38.986029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 613/1252] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:38.992499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40abb71-7b8d-4002-a809-feb5c2d53700 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:39.094749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40abb71-7b8d-4002-a809-feb5c2d53700 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:39.123010 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:39.131960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51246-25a5-4b6f-b0a8-054fb1fa2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:39.132780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51246-25a5-4b6f-b0a8-054fb1fa2d69 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:39.133048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51246-25a5-4b6f-b0a8-054fb1fa2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:39.133323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51246-25a5-4b6f-b0a8-054fb1fa2d69 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:39.141444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a51246-25a5-4b6f-b0a8-054fb1fa2d69 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:39.143094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a51246-25a5-4b6f-b0a8-054fb1fa2d69 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-e9a51246-25a5-4b6f-b0a8-054fb1fa2d69 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:36:39.158422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:39.159505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:39.160766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 640/1253] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:39.165551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63412d4b-ad71-4fa2-9085-f19c92e4c90a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:39.226275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:39.272490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63412d4b-ad71-4fa2-9085-f19c92e4c90a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:39.307621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488081c5-2496-4573-892d-8771836ecf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:39.308288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488081c5-2496-4573-892d-8771836ecf2f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:39.308571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488081c5-2496-4573-892d-8771836ecf2f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:39.308845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488081c5-2496-4573-892d-8771836ecf2f None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:39.309665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488081c5-2496-4573-892d-8771836ecf2f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:39.309970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488081c5-2496-4573-892d-8771836ecf2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:39.311556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488081c5-2496-4573-892d-8771836ecf2f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:39.329183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 614/1254] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Jun 17 08:36:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:39.334927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51246-25a5-4b6f-b0a8-054fb1fa2d69 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:39.440453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51246-25a5-4b6f-b0a8-054fb1fa2d69 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:39.473928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dcca7-5048-4d13-9a50-1b9b944c30a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:39.474597 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dcca7-5048-4d13-9a50-1b9b944c30a1 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:39.474880 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dcca7-5048-4d13-9a50-1b9b944c30a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:39.475162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dcca7-5048-4d13-9a50-1b9b944c30a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:39.534781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:39.547327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dcca7-5048-4d13-9a50-1b9b944c30a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:39.548888 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dcca7-5048-4d13-9a50-1b9b944c30a1 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:39.647518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 641/1255] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:36:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:36:39.653593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488081c5-2496-4573-892d-8771836ecf2f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:39.756027 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488081c5-2496-4573-892d-8771836ecf2f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:39.773150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:39.798168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0e6a5-09f8-4c94-abeb-85e17bb62e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:39.798918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0e6a5-09f8-4c94-abeb-85e17bb62e79 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:39.799203 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0e6a5-09f8-4c94-abeb-85e17bb62e79 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:39.799512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0e6a5-09f8-4c94-abeb-85e17bb62e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:39.810131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0e6a5-09f8-4c94-abeb-85e17bb62e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:39.811650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0e6a5-09f8-4c94-abeb-85e17bb62e79 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-40f0e6a5-09f8-4c94-abeb-85e17bb62e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:39.829997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:39.831058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:39.832139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:39.832139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:39.832139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:39.832139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:39.832139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 615/1256] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:39.837450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dcca7-5048-4d13-9a50-1b9b944c30a1 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:39.934133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:39.946580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dcca7-5048-4d13-9a50-1b9b944c30a1 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:39.980671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcaa97-17e0-4abc-9d4d-7daaaeeff4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:39.981365 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcaa97-17e0-4abc-9d4d-7daaaeeff4b7 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:39.981652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcaa97-17e0-4abc-9d4d-7daaaeeff4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:39.981930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcaa97-17e0-4abc-9d4d-7daaaeeff4b7 None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:39.982646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcaa97-17e0-4abc-9d4d-7daaaeeff4b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:39.982979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcaa97-17e0-4abc-9d4d-7daaaeeff4b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:39.984375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcaa97-17e0-4abc-9d4d-7daaaeeff4b7 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:39.995320 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 642/1257] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:40.002013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0e6a5-09f8-4c94-abeb-85e17bb62e79 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:40.107304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0e6a5-09f8-4c94-abeb-85e17bb62e79 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:40.141653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bec1aa-8b68-4a16-a6ba-248342d9d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:40.142446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bec1aa-8b68-4a16-a6ba-248342d9d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:40.142725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bec1aa-8b68-4a16-a6ba-248342d9d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:40.142999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bec1aa-8b68-4a16-a6ba-248342d9d2b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:40.149992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bec1aa-8b68-4a16-a6ba-248342d9d2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:40.151453 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bec1aa-8b68-4a16-a6ba-248342d9d2b0 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-18bec1aa-8b68-4a16-a6ba-248342d9d2b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:36:40.165450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:40.171285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:40.172310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:36:40.172310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:36:40.172310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:36:40.172310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:36:40.172310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:36:40.172310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:36:40.172310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:40.172310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:40.172310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 616/1258] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:40.172881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcaa97-17e0-4abc-9d4d-7daaaeeff4b7 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:40.272821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcaa97-17e0-4abc-9d4d-7daaaeeff4b7 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:40.305872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6372e84-f49c-4932-9317-64fc0e629ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:40.306519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6372e84-f49c-4932-9317-64fc0e629ca6 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:40.306805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6372e84-f49c-4932-9317-64fc0e629ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:40.307081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6372e84-f49c-4932-9317-64fc0e629ca6 None admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:40.307892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6372e84-f49c-4932-9317-64fc0e629ca6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:40.308200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6372e84-f49c-4932-9317-64fc0e629ca6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:40.309629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6372e84-f49c-4932-9317-64fc0e629ca6 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:40.321950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 643/1259] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:40.328629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bec1aa-8b68-4a16-a6ba-248342d9d2b0 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:40.354605 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:40.432486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bec1aa-8b68-4a16-a6ba-248342d9d2b0 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:40.466707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd361c1-1464-4851-9334-9ffc79aa7178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:40.467443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd361c1-1464-4851-9334-9ffc79aa7178 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:40.467936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd361c1-1464-4851-9334-9ffc79aa7178 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:40.468222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd361c1-1464-4851-9334-9ffc79aa7178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:40.469048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd361c1-1464-4851-9334-9ffc79aa7178 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=f79f43c31f5346d5b1e6ae6ff8c511a8) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:40.469361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd361c1-1464-4851-9334-9ffc79aa7178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:40.470784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd361c1-1464-4851-9334-9ffc79aa7178 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:40.476294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 617/1260] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:36:40 2022] GET /identity/v3/role_assignments?user.id=f79f43c31f5346d5b1e6ae6ff8c511a8&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:42.602839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83949c2f-14cb-4927-b7a0-e2aa4f660237 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:42.603437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83949c2f-14cb-4927-b7a0-e2aa4f660237 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:42.603437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83949c2f-14cb-4927-b7a0-e2aa4f660237 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:42.604795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 644/1261] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:42.610812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb5431-3070-4c90-be69-cfda7ce11110 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:42.611225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb5431-3070-4c90-be69-cfda7ce11110 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:42.611421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb5431-3070-4c90-be69-cfda7ce11110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:42.629267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f7bb5431-3070-4c90-be69-cfda7ce11110 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:42.632989 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f7bb5431-3070-4c90-be69-cfda7ce11110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:42.697373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 618/1262] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:36:42.720343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83949c2f-14cb-4927-b7a0-e2aa4f660237 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:42.731334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:42.828849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83949c2f-14cb-4927-b7a0-e2aa4f660237 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:42.863317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a92c7-8559-4002-b2e1-66d11fd7409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:42.864231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a92c7-8559-4002-b2e1-66d11fd7409e None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:42.864512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a92c7-8559-4002-b2e1-66d11fd7409e None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:42.864788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a92c7-8559-4002-b2e1-66d11fd7409e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:42.875997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a92c7-8559-4002-b2e1-66d11fd7409e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-571a92c7-8559-4002-b2e1-66d11fd7409e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:36:42.883833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:42.885022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:42.886005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 645/1263] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:36:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:42.892187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb5431-3070-4c90-be69-cfda7ce11110 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:42.910625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:42.990375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb5431-3070-4c90-be69-cfda7ce11110 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:43.023827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad100a4-57ce-421f-a154-d78f5b0a4a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:43.024486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad100a4-57ce-421f-a154-d78f5b0a4a53 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:43.024771 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad100a4-57ce-421f-a154-d78f5b0a4a53 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:43.025048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad100a4-57ce-421f-a154-d78f5b0a4a53 None admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:43.025783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad100a4-57ce-421f-a154-d78f5b0a4a53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:43.026088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad100a4-57ce-421f-a154-d78f5b0a4a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:43.027555 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad100a4-57ce-421f-a154-d78f5b0a4a53 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:43.037372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 619/1264] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:36:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:43.043563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a92c7-8559-4002-b2e1-66d11fd7409e None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:43.109855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:43.142393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a92c7-8559-4002-b2e1-66d11fd7409e None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:43.176956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ec19-cab4-45c1-91b5-c6501a73d5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:43.177749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ec19-cab4-45c1-91b5-c6501a73d5f7 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:43.178028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ec19-cab4-45c1-91b5-c6501a73d5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:43.178304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21ec19-cab4-45c1-91b5-c6501a73d5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:43.189518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ec19-cab4-45c1-91b5-c6501a73d5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:43.190951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21ec19-cab4-45c1-91b5-c6501a73d5f7 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-5c21ec19-cab4-45c1-91b5-c6501a73d5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:43.207850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:43.208973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:43.209865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:43.209865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:43.209865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:43.209865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:43.209865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 646/1265] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:43.214761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad100a4-57ce-421f-a154-d78f5b0a4a53 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:43.298333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:43.317377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad100a4-57ce-421f-a154-d78f5b0a4a53 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:43.351290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284f04e-9b62-45f5-b541-cd6e6dcccc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:43.351977 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284f04e-9b62-45f5-b541-cd6e6dcccc8d None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:43.352257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284f04e-9b62-45f5-b541-cd6e6dcccc8d None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:43.352531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284f04e-9b62-45f5-b541-cd6e6dcccc8d None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:43.353319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284f04e-9b62-45f5-b541-cd6e6dcccc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:43.353618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284f04e-9b62-45f5-b541-cd6e6dcccc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:43.354976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284f04e-9b62-45f5-b541-cd6e6dcccc8d None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:43.366100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 620/1266] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:43.371842 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ec19-cab4-45c1-91b5-c6501a73d5f7 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:43.472247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21ec19-cab4-45c1-91b5-c6501a73d5f7 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:43.492013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:43.507069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fd18d-261b-4458-b5b8-5b025cf0c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:43.507904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd18d-261b-4458-b5b8-5b025cf0c331 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:43.508188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd18d-261b-4458-b5b8-5b025cf0c331 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:43.508461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd18d-261b-4458-b5b8-5b025cf0c331 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:43.516759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fd18d-261b-4458-b5b8-5b025cf0c331 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:43.518193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fd18d-261b-4458-b5b8-5b025cf0c331 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-ba0fd18d-261b-4458-b5b8-5b025cf0c331 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:36:43.533195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:43.534901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:43.536181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 647/1267] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:43.540520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284f04e-9b62-45f5-b541-cd6e6dcccc8d None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:43.646961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284f04e-9b62-45f5-b541-cd6e6dcccc8d None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:43.680048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dddfe-a5c1-44c4-a89a-71039d603103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:43.680716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dddfe-a5c1-44c4-a89a-71039d603103 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:43.681000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dddfe-a5c1-44c4-a89a-71039d603103 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:43.681280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dddfe-a5c1-44c4-a89a-71039d603103 None admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:43.682126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dddfe-a5c1-44c4-a89a-71039d603103 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:43.682416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dddfe-a5c1-44c4-a89a-71039d603103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:43.683890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dddfe-a5c1-44c4-a89a-71039d603103 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:43.693628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:43.702938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 621/1268] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Jun 17 08:36:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:43.708629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fd18d-261b-4458-b5b8-5b025cf0c331 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:43.811084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fd18d-261b-4458-b5b8-5b025cf0c331 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:43.844846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089333a-c5b8-4952-ab7b-e27139dd8d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:43.845639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089333a-c5b8-4952-ab7b-e27139dd8d4a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:43.845922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089333a-c5b8-4952-ab7b-e27139dd8d4a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:43.846201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089333a-c5b8-4952-ab7b-e27139dd8d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:43.856942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089333a-c5b8-4952-ab7b-e27139dd8d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:43.862494 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089333a-c5b8-4952-ab7b-e27139dd8d4a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-5089333a-c5b8-4952-ab7b-e27139dd8d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:43.876004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:43.877050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:43.878120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:43.878120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:43.878120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:43.878120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:43.878120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 648/1269] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:43.883011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dddfe-a5c1-44c4-a89a-71039d603103 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:43.985272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dddfe-a5c1-44c4-a89a-71039d603103 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:44.018685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8dd9-33fb-4400-90e7-fc9007c663b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:44.019417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8dd9-33fb-4400-90e7-fc9007c663b9 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:44.019743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8dd9-33fb-4400-90e7-fc9007c663b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:44.020165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8dd9-33fb-4400-90e7-fc9007c663b9 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:44.020942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8dd9-33fb-4400-90e7-fc9007c663b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:44.021384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8dd9-33fb-4400-90e7-fc9007c663b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:44.022736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8dd9-33fb-4400-90e7-fc9007c663b9 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:44.034594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 622/1270] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:44.040405 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089333a-c5b8-4952-ab7b-e27139dd8d4a None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:44.071688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:44.143628 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089333a-c5b8-4952-ab7b-e27139dd8d4a None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:44.178470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13755b25-a753-4206-9319-6e25f66ce4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:44.179257 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13755b25-a753-4206-9319-6e25f66ce4f3 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:44.179570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13755b25-a753-4206-9319-6e25f66ce4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:44.179851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13755b25-a753-4206-9319-6e25f66ce4f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:44.186544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13755b25-a753-4206-9319-6e25f66ce4f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:44.188024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13755b25-a753-4206-9319-6e25f66ce4f3 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-13755b25-a753-4206-9319-6e25f66ce4f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:36:44.202417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:44.203674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:44.204856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:36:44.204856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:36:44.204856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:36:44.204856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:36:44.204856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:36:44.204856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:36:44.204856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:44.204856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:44.204856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 649/1271] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:44.209657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8dd9-33fb-4400-90e7-fc9007c663b9 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:44.269813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:44.310749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8dd9-33fb-4400-90e7-fc9007c663b9 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:44.343752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b7f51-2421-43d8-a3f2-3b9be34cbead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:44.344412 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b7f51-2421-43d8-a3f2-3b9be34cbead None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:44.344693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b7f51-2421-43d8-a3f2-3b9be34cbead None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:44.344969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b7f51-2421-43d8-a3f2-3b9be34cbead None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:44.345741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b7f51-2421-43d8-a3f2-3b9be34cbead None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:44.346050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b7f51-2421-43d8-a3f2-3b9be34cbead None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:44.347510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b7f51-2421-43d8-a3f2-3b9be34cbead None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:44.359191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 623/1272] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:36:44.365292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13755b25-a753-4206-9319-6e25f66ce4f3 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:44.458657 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:44.467129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13755b25-a753-4206-9319-6e25f66ce4f3 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:44.501755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ca3ae-d2ad-4fd2-927f-a1f73218616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:44.502711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ca3ae-d2ad-4fd2-927f-a1f73218616c None admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:44.502989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ca3ae-d2ad-4fd2-927f-a1f73218616c None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:44.503262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ca3ae-d2ad-4fd2-927f-a1f73218616c None admin] PATH_INFO: `/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/f79f43c31f5346d5b1e6ae6ff8c511a8/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:44.505260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ca3ae-d2ad-4fd2-927f-a1f73218616c None admin] RBAC: Authorizing `identity:create_grant(project_id=e535300d1cb64f5bba44d5a23b34276a, user_id=f79f43c31f5346d5b1e6ae6ff8c511a8, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:44.506689 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ca3ae-d2ad-4fd2-927f-a1f73218616c None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:44.622694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 650/1273] 10.222.0.78 () {58 vars in 1439 bytes} [Fri Jun 17 08:36:44 2022] PUT /identity/v3/projects/e535300d1cb64f5bba44d5a23b34276a/users/f79f43c31f5346d5b1e6ae6ff8c511a8/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:36:46.726959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e13dd-e8c7-440e-9611-d6963849985c None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.727497 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e13dd-e8c7-440e-9611-d6963849985c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.727497 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e13dd-e8c7-440e-9611-d6963849985c None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.728828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 624/1274] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:46.734490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b61c-5e70-45d9-8fca-ee3aef577c7f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.734932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b61c-5e70-45d9-8fca-ee3aef577c7f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.735086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b61c-5e70-45d9-8fca-ee3aef577c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:46.753348 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-6ef1b61c-5e70-45d9-8fca-ee3aef577c7f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:46.754601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6ef1b61c-5e70-45d9-8fca-ee3aef577c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:46.825612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 651/1275] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:36:46.850282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e13dd-e8c7-440e-9611-d6963849985c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:46.962111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e13dd-e8c7-440e-9611-d6963849985c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:46.980317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:46.997495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18351e3-61f2-4f83-89cb-91bdd4e65086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:46.998298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18351e3-61f2-4f83-89cb-91bdd4e65086 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:46.999082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18351e3-61f2-4f83-89cb-91bdd4e65086 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:46.999426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18351e3-61f2-4f83-89cb-91bdd4e65086 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.009797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18351e3-61f2-4f83-89cb-91bdd4e65086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-b18351e3-61f2-4f83-89cb-91bdd4e65086 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 08:36:47.017972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:47.019635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:47.020716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 625/1276] 10.222.0.78 () {56 vars in 1096 bytes} [Fri Jun 17 08:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:47.025211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1b61c-5e70-45d9-8fca-ee3aef577c7f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.110632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:47.135291 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1b61c-5e70-45d9-8fca-ee3aef577c7f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.169291 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13522d17-34c6-4d36-af26-3b1e0510785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.169954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13522d17-34c6-4d36-af26-3b1e0510785a None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.170860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13522d17-34c6-4d36-af26-3b1e0510785a None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.171235 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13522d17-34c6-4d36-af26-3b1e0510785a None admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.172276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13522d17-34c6-4d36-af26-3b1e0510785a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:47.172583 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13522d17-34c6-4d36-af26-3b1e0510785a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.173952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13522d17-34c6-4d36-af26-3b1e0510785a None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.181840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 652/1277] 10.222.0.78 () {56 vars in 1099 bytes} [Fri Jun 17 08:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:47.189789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18351e3-61f2-4f83-89cb-91bdd4e65086 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.313297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18351e3-61f2-4f83-89cb-91bdd4e65086 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.356670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f3275-3328-425c-88c3-5c0f01f0a212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.358333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f3275-3328-425c-88c3-5c0f01f0a212 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.358681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f3275-3328-425c-88c3-5c0f01f0a212 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.358876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f3275-3328-425c-88c3-5c0f01f0a212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.372836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f3275-3328-425c-88c3-5c0f01f0a212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.374973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f3275-3328-425c-88c3-5c0f01f0a212 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-096f3275-3328-425c-88c3-5c0f01f0a212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:47.393103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:47.395006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:47.396765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:47.396765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:47.396765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:47.396765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:47.396765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 626/1278] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:47.400447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13522d17-34c6-4d36-af26-3b1e0510785a None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.505984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13522d17-34c6-4d36-af26-3b1e0510785a None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.543067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cc09-2171-4633-ad07-e11ffeae263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.543785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cc09-2171-4633-ad07-e11ffeae263d None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.544078 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cc09-2171-4633-ad07-e11ffeae263d None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.544358 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cc09-2171-4633-ad07-e11ffeae263d None admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.545926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571cc09-2171-4633-ad07-e11ffeae263d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:47.546404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571cc09-2171-4633-ad07-e11ffeae263d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.548048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571cc09-2171-4633-ad07-e11ffeae263d None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.560697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 653/1279] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:47.566932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f3275-3328-425c-88c3-5c0f01f0a212 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.599857 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:47.673412 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f3275-3328-425c-88c3-5c0f01f0a212 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.712056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c908d6-3dae-41ea-b751-860d5f02a928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.713046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c908d6-3dae-41ea-b751-860d5f02a928 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.713506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c908d6-3dae-41ea-b751-860d5f02a928 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.713797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c908d6-3dae-41ea-b751-860d5f02a928 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.723605 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c908d6-3dae-41ea-b751-860d5f02a928 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.725629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c908d6-3dae-41ea-b751-860d5f02a928 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-28c908d6-3dae-41ea-b751-860d5f02a928 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 08:36:47.742739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:47.744908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:47.746272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 627/1280] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:47.750677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cc09-2171-4633-ad07-e11ffeae263d None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:47.755865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:47.867592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cc09-2171-4633-ad07-e11ffeae263d None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:47.902429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b039028-b472-4b47-8529-db4be0a047d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:47.903192 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b039028-b472-4b47-8529-db4be0a047d2 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:47.903557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b039028-b472-4b47-8529-db4be0a047d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:47.903838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b039028-b472-4b47-8529-db4be0a047d2 None admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:47.905641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b039028-b472-4b47-8529-db4be0a047d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:47.906170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b039028-b472-4b47-8529-db4be0a047d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:47.907622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b039028-b472-4b47-8529-db4be0a047d2 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:47.930037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 654/1281] 10.222.0.78 () {56 vars in 1143 bytes} [Fri Jun 17 08:36:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:47.936451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c908d6-3dae-41ea-b751-860d5f02a928 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:48.028740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:48.038935 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c908d6-3dae-41ea-b751-860d5f02a928 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:48.072339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d93564-ebeb-49a5-8af1-f0f11bc50e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:48.073245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d93564-ebeb-49a5-8af1-f0f11bc50e00 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:48.073531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d93564-ebeb-49a5-8af1-f0f11bc50e00 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:48.073809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d93564-ebeb-49a5-8af1-f0f11bc50e00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:48.141811 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d93564-ebeb-49a5-8af1-f0f11bc50e00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:48.143194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d93564-ebeb-49a5-8af1-f0f11bc50e00 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:48.232617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:48.243176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 628/1282] 10.222.0.78 () {58 vars in 1282 bytes} [Fri Jun 17 08:36:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 08:36:48.250000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b039028-b472-4b47-8529-db4be0a047d2 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:48.312462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:48.351014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b039028-b472-4b47-8529-db4be0a047d2 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:48.384640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635007c4-b18b-40ac-9bf2-f921f4a0fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:48.385426 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635007c4-b18b-40ac-9bf2-f921f4a0fa83 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:48.385709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635007c4-b18b-40ac-9bf2-f921f4a0fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:48.385983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635007c4-b18b-40ac-9bf2-f921f4a0fa83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:48.402418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635007c4-b18b-40ac-9bf2-f921f4a0fa83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:48.402418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635007c4-b18b-40ac-9bf2-f921f4a0fa83 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-635007c4-b18b-40ac-9bf2-f921f4a0fa83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 08:36:48.415044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:48.416087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:48.417083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 08:36:48.417083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 08:36:48.417083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 08:36:48.417083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:48.417083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 655/1283] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:48.422301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d93564-ebeb-49a5-8af1-f0f11bc50e00 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:48.525383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d93564-ebeb-49a5-8af1-f0f11bc50e00 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:48.558916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52274083-0402-42ae-a94c-01d88d82a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:48.559590 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52274083-0402-42ae-a94c-01d88d82a873 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:48.559870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52274083-0402-42ae-a94c-01d88d82a873 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:48.560142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52274083-0402-42ae-a94c-01d88d82a873 None admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:48.561385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52274083-0402-42ae-a94c-01d88d82a873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:48.561835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52274083-0402-42ae-a94c-01d88d82a873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:48.563272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52274083-0402-42ae-a94c-01d88d82a873 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:48.574500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 629/1284] 10.222.0.78 () {56 vars in 1109 bytes} [Fri Jun 17 08:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:48.580244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635007c4-b18b-40ac-9bf2-f921f4a0fa83 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:48.686468 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635007c4-b18b-40ac-9bf2-f921f4a0fa83 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:48.700344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:48.721256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aaf67-7c84-4b44-bb28-319dbdee8541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:48.722047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aaf67-7c84-4b44-bb28-319dbdee8541 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:48.722332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aaf67-7c84-4b44-bb28-319dbdee8541 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:48.722610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aaf67-7c84-4b44-bb28-319dbdee8541 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:48.729349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9aaf67-7c84-4b44-bb28-319dbdee8541 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:48.730863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9aaf67-7c84-4b44-bb28-319dbdee8541 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application [None req-2a9aaf67-7c84-4b44-bb28-319dbdee8541 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 08:36:48.745830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:48.746851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:48.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 08:36:48.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 08:36:48.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 08:36:48.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 08:36:48.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 08:36:48.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 08:36:48.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 08:36:48.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: ERROR keystone.server.flask.application Jun 17 08:36:48.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 656/1285] 10.222.0.78 () {56 vars in 1111 bytes} [Fri Jun 17 08:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:48.753725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52274083-0402-42ae-a94c-01d88d82a873 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:48.804832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:48.852886 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52274083-0402-42ae-a94c-01d88d82a873 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:48.885588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0d5d1-e6b1-4d13-b6ca-19e825f719de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:48.886233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d5d1-e6b1-4d13-b6ca-19e825f719de None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:48.886544 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d5d1-e6b1-4d13-b6ca-19e825f719de None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:48.886816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0d5d1-e6b1-4d13-b6ca-19e825f719de None admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:48.887617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0d5d1-e6b1-4d13-b6ca-19e825f719de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:48.887924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0d5d1-e6b1-4d13-b6ca-19e825f719de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:48.889400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0d5d1-e6b1-4d13-b6ca-19e825f719de None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:48.901003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 630/1286] 10.222.0.78 () {56 vars in 1148 bytes} [Fri Jun 17 08:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:48.908132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aaf67-7c84-4b44-bb28-319dbdee8541 None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:49.016234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aaf67-7c84-4b44-bb28-319dbdee8541 None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:49.054294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ce012-dd34-4112-87c3-b002833fadd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:49.054976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ce012-dd34-4112-87c3-b002833fadd5 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:49.055263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ce012-dd34-4112-87c3-b002833fadd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:49.055577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ce012-dd34-4112-87c3-b002833fadd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:49.056445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ce012-dd34-4112-87c3-b002833fadd5 None admin] RBAC: Adding query filter params (role.id=f48ecf575a01426ba9d2a703e05dca80, scope.project.id=e535300d1cb64f5bba44d5a23b34276a, user.id=f79f43c31f5346d5b1e6ae6ff8c511a8) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:49.056879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ce012-dd34-4112-87c3-b002833fadd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:49.058358 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ce012-dd34-4112-87c3-b002833fadd5 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:49.065890 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 657/1287] 10.222.0.78 () {56 vars in 1374 bytes} [Fri Jun 17 08:36:48 2022] GET /identity/v3/role_assignments?user.id=f79f43c31f5346d5b1e6ae6ff8c511a8&scope.project.id=e535300d1cb64f5bba44d5a23b34276a&role.id=f48ecf575a01426ba9d2a703e05dca80 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:51.225753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9d0ba-38bd-48e5-959d-4966e19514a4 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:51.226354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9d0ba-38bd-48e5-959d-4966e19514a4 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:51.226354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9d0ba-38bd-48e5-959d-4966e19514a4 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:51.227734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 631/1288] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:51.232883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6b141-d537-4525-9ddb-b9c6fbcedd76 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:51.233309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6b141-d537-4525-9ddb-b9c6fbcedd76 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:51.233498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6b141-d537-4525-9ddb-b9c6fbcedd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:51.250638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-8df6b141-d537-4525-9ddb-b9c6fbcedd76 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:51.251865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-8df6b141-d537-4525-9ddb-b9c6fbcedd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:51.281356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:51.318686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 658/1289] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 08:36:51.342147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9d0ba-38bd-48e5-959d-4966e19514a4 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:51.444808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9d0ba-38bd-48e5-959d-4966e19514a4 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:51.457488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:51.480873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8718591-8f0d-4d2c-b1e5-94b72b47d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:51.481600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8718591-8f0d-4d2c-b1e5-94b72b47d91f None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:51.481880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8718591-8f0d-4d2c-b1e5-94b72b47d91f None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:51.482154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8718591-8f0d-4d2c-b1e5-94b72b47d91f None admin] PATH_INFO: `/v3/services/placement` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:51.482796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8718591-8f0d-4d2c-b1e5-94b72b47d91f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:51.484480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8718591-8f0d-4d2c-b1e5-94b72b47d91f None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-e8718591-8f0d-4d2c-b1e5-94b72b47d91f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:51.496439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:51.497731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:51.499668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 632/1290] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Jun 17 08:36:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:51.504339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6b141-d537-4525-9ddb-b9c6fbcedd76 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:51.603368 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6b141-d537-4525-9ddb-b9c6fbcedd76 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:51.637770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa9154-8e9d-486d-aaed-4db4274a83d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:51.638482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa9154-8e9d-486d-aaed-4db4274a83d8 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:51.638767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa9154-8e9d-486d-aaed-4db4274a83d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:51.639173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa9154-8e9d-486d-aaed-4db4274a83d8 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:51.639931 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa9154-8e9d-486d-aaed-4db4274a83d8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:51.640238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa9154-8e9d-486d-aaed-4db4274a83d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:51.641667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa9154-8e9d-486d-aaed-4db4274a83d8 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:51.646542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 659/1291] 10.222.0.78 () {56 vars in 1116 bytes} [Fri Jun 17 08:36:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:51.652309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8718591-8f0d-4d2c-b1e5-94b72b47d91f None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:51.751635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8718591-8f0d-4d2c-b1e5-94b72b47d91f None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:51.784498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941cec3-20fa-409d-a9d4-31cdb633b0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:51.785146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941cec3-20fa-409d-a9d4-31cdb633b0ae None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:51.785427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941cec3-20fa-409d-a9d4-31cdb633b0ae None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:51.785724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941cec3-20fa-409d-a9d4-31cdb633b0ae None admin] PATH_INFO: `/v3/services` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:51.786407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941cec3-20fa-409d-a9d4-31cdb633b0ae None admin] RBAC: Adding query filter params (type=placement) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:51.786713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941cec3-20fa-409d-a9d4-31cdb633b0ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:51.788140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941cec3-20fa-409d-a9d4-31cdb633b0ae None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:51.792603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 633/1292] 10.222.0.78 () {56 vars in 1116 bytes} [Fri Jun 17 08:36:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:53.918600 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2659c9-1190-42b0-9c21-90b4d9c53910 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:53.919161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2659c9-1190-42b0-9c21-90b4d9c53910 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:53.919161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2659c9-1190-42b0-9c21-90b4d9c53910 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:53.920911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 660/1293] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:53.926109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be5ba3-d913-41da-b90f-e1cdc943a858 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:53.926545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be5ba3-d913-41da-b90f-e1cdc943a858 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:53.926698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be5ba3-d913-41da-b90f-e1cdc943a858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:53.943166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c5be5ba3-d913-41da-b90f-e1cdc943a858 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:53.944365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c5be5ba3-d913-41da-b90f-e1cdc943a858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:53.974327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:54.011552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 634/1294] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:36:54.035763 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2659c9-1190-42b0-9c21-90b4d9c53910 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:54.065955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:54.135167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2659c9-1190-42b0-9c21-90b4d9c53910 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:54.168752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7e0de-390a-493f-b524-45d4092823fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:54.169347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7e0de-390a-493f-b524-45d4092823fc None admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:54.169631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7e0de-390a-493f-b524-45d4092823fc None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:54.169908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7e0de-390a-493f-b524-45d4092823fc None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:54.170686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7e0de-390a-493f-b524-45d4092823fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:54.172073 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7e0de-390a-493f-b524-45d4092823fc None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:54.256515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 661/1295] 10.222.0.78 () {60 vars in 1141 bytes} [Fri Jun 17 08:36:54 2022] POST /identity/v3/services => generated 246 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:36:56.368700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c898ea0-a3ef-41ab-98f5-979ad1f90f53 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:56.369293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c898ea0-a3ef-41ab-98f5-979ad1f90f53 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:56.369293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c898ea0-a3ef-41ab-98f5-979ad1f90f53 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:56.370689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 635/1296] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:36:56.376480 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217d23-8cab-4f09-986d-a52f00f4fb10 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:56.378985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217d23-8cab-4f09-986d-a52f00f4fb10 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:56.378985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de217d23-8cab-4f09-986d-a52f00f4fb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:56.394055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-de217d23-8cab-4f09-986d-a52f00f4fb10 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:56.395225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-de217d23-8cab-4f09-986d-a52f00f4fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:56.467872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 662/1297] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:36:56.490899 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c898ea0-a3ef-41ab-98f5-979ad1f90f53 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:56.591788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c898ea0-a3ef-41ab-98f5-979ad1f90f53 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:56.626281 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ba9e1-1512-4a74-9e1a-6c65098a987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:56.627042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba9e1-1512-4a74-9e1a-6c65098a987a None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:56.627339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba9e1-1512-4a74-9e1a-6c65098a987a None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:56.637077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba9e1-1512-4a74-9e1a-6c65098a987a None admin] PATH_INFO: `/v3/services/placement` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:56.637077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ba9e1-1512-4a74-9e1a-6c65098a987a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:56.637077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ba9e1-1512-4a74-9e1a-6c65098a987a None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-ac4ba9e1-1512-4a74-9e1a-6c65098a987a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:56.641780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:56.642945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:56.644059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 636/1298] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Jun 17 08:36:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 08:36:56.649046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de217d23-8cab-4f09-986d-a52f00f4fb10 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:56.667218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:56.746415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de217d23-8cab-4f09-986d-a52f00f4fb10 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:56.779259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37b37-89f6-4d3c-abf8-3ea7a9c890fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:56.780156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37b37-89f6-4d3c-abf8-3ea7a9c890fe None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:56.780445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37b37-89f6-4d3c-abf8-3ea7a9c890fe None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:56.780722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37b37-89f6-4d3c-abf8-3ea7a9c890fe None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:56.781440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c37b37-89f6-4d3c-abf8-3ea7a9c890fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:56.781755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c37b37-89f6-4d3c-abf8-3ea7a9c890fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:56.784207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c37b37-89f6-4d3c-abf8-3ea7a9c890fe None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:56.789256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 663/1299] 10.222.0.78 () {56 vars in 1116 bytes} [Fri Jun 17 08:36:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:56.797805 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ba9e1-1512-4a74-9e1a-6c65098a987a None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:56.828807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:56.898122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ba9e1-1512-4a74-9e1a-6c65098a987a None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:56.932749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cc25a-6bc7-4440-9a34-27455582cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:56.933436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc25a-6bc7-4440-9a34-27455582cc95 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:56.933740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc25a-6bc7-4440-9a34-27455582cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:56.934017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc25a-6bc7-4440-9a34-27455582cc95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:56.934799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cc25a-6bc7-4440-9a34-27455582cc95 None admin] RBAC: Adding query filter params (interface=public, service_id=80a7fee63c714268a5777d3325c72575, region_id=RegionOne) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:56.935154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cc25a-6bc7-4440-9a34-27455582cc95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:56.937488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cc25a-6bc7-4440-9a34-27455582cc95 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:56.942575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 637/1300] 10.222.0.78 () {56 vars in 1251 bytes} [Fri Jun 17 08:36:56 2022] GET /identity/v3/endpoints?service_id=80a7fee63c714268a5777d3325c72575&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:56.948562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37b37-89f6-4d3c-abf8-3ea7a9c890fe None admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:57.028209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:57.046024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37b37-89f6-4d3c-abf8-3ea7a9c890fe None admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:57.079013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be3972-9ff8-4a12-85be-e424d7038614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:57.079690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be3972-9ff8-4a12-85be-e424d7038614 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:57.079972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be3972-9ff8-4a12-85be-e424d7038614 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:57.080244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be3972-9ff8-4a12-85be-e424d7038614 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:57.080911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be3972-9ff8-4a12-85be-e424d7038614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:57.082278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be3972-9ff8-4a12-85be-e424d7038614 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:57.089014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 664/1301] 10.222.0.78 () {56 vars in 1087 bytes} [Fri Jun 17 08:36:56 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:36:59.194817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715907e-6d29-44c2-a781-182a57c7d1bb None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.195477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715907e-6d29-44c2-a781-182a57c7d1bb None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.195477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715907e-6d29-44c2-a781-182a57c7d1bb None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.196758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 638/1302] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:36:59.202871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ffad0-9a84-45d0-adbd-c192e3ce8e34 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.203428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ffad0-9a84-45d0-adbd-c192e3ce8e34 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.203560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ffad0-9a84-45d0-adbd-c192e3ce8e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.220966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a92ffad0-9a84-45d0-adbd-c192e3ce8e34 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:36:59.222148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a92ffad0-9a84-45d0-adbd-c192e3ce8e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:36:59.288882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 665/1303] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:36:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 08:36:59.312349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715907e-6d29-44c2-a781-182a57c7d1bb None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:59.407793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:59.414302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715907e-6d29-44c2-a781-182a57c7d1bb None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:59.447774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f23c88-dc6c-4817-b74f-cf61f799b5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:59.448495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23c88-dc6c-4817-b74f-cf61f799b5d6 None admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.448774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23c88-dc6c-4817-b74f-cf61f799b5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.449043 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23c88-dc6c-4817-b74f-cf61f799b5d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.449712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f23c88-dc6c-4817-b74f-cf61f799b5d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:59.451148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f23c88-dc6c-4817-b74f-cf61f799b5d6 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application [None req-47f23c88-dc6c-4817-b74f-cf61f799b5d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 08:36:59.463663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 08:36:59.464903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application with Lock( Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self._enter() Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application return self.creator() Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application created_value = creator( Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: ERROR keystone.server.flask.application Jun 17 08:36:59.466196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 639/1304] 10.222.0.78 () {56 vars in 1117 bytes} [Fri Jun 17 08:36:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 08:36:59.471413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ffad0-9a84-45d0-adbd-c192e3ce8e34 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:59.547585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:36:59.569332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ffad0-9a84-45d0-adbd-c192e3ce8e34 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:59.602832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637ad65-c961-4a37-b543-b384e6327538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:59.603517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ad65-c961-4a37-b543-b384e6327538 None admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.603805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ad65-c961-4a37-b543-b384e6327538 None admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.604082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ad65-c961-4a37-b543-b384e6327538 None admin] PATH_INFO: `/v3/services` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.604783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637ad65-c961-4a37-b543-b384e6327538 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:36:59.605091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637ad65-c961-4a37-b543-b384e6327538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:59.606461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637ad65-c961-4a37-b543-b384e6327538 None admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:59.617002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 666/1305] 10.222.0.78 () {56 vars in 1116 bytes} [Fri Jun 17 08:36:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:36:59.618321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f23c88-dc6c-4817-b74f-cf61f799b5d6 None admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:36:59.715997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f23c88-dc6c-4817-b74f-cf61f799b5d6 None admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:36:59.750727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a131af0-8ca4-44e4-a221-e8a113a8bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:36:59.751395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a131af0-8ca4-44e4-a221-e8a113a8bc78 None admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:36:59.751670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a131af0-8ca4-44e4-a221-e8a113a8bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:36:59.751940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a131af0-8ca4-44e4-a221-e8a113a8bc78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:36:59.752671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a131af0-8ca4-44e4-a221-e8a113a8bc78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:36:59.754013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a131af0-8ca4-44e4-a221-e8a113a8bc78 None admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:36:59.851587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 640/1306] 10.222.0.78 () {60 vars in 1144 bytes} [Fri Jun 17 08:36:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:37:09.613149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=30 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:37:09.846742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:22.361601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da758a-8335-4da3-8e02-11e592b80e0b None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:22.362092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da758a-8335-4da3-8e02-11e592b80e0b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:22.362185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da758a-8335-4da3-8e02-11e592b80e0b None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:22.374650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7707799-2b5f-4663-aa6a-460251589b3e None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:22.374650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7707799-2b5f-4663-aa6a-460251589b3e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:22.374650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7707799-2b5f-4663-aa6a-460251589b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:22.375208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 667/1307] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:22 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:22.533987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c7707799-2b5f-4663-aa6a-460251589b3e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:22.535897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c7707799-2b5f-4663-aa6a-460251589b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:22.656768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 641/1308] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:43:22.709206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34138f-5329-4314-9d84-19b2bd5c755b None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:22.709500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34138f-5329-4314-9d84-19b2bd5c755b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:22.709977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34138f-5329-4314-9d84-19b2bd5c755b None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:22.711340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 668/1309] 10.222.0.78 () {54 vars in 964 bytes} [Fri Jun 17 08:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:22.718272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6c390-c779-458f-a4cc-d006be04c6ee None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:22.718713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6c390-c779-458f-a4cc-d006be04c6ee None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:22.718982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6c390-c779-458f-a4cc-d006be04c6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:22.798061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-02c6c390-c779-458f-a4cc-d006be04c6ee None None] MFA Rules not processed for user `024e0e53cfdb42e88dfdfde7a79e8c75`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:22.799310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-02c6c390-c779-458f-a4cc-d006be04c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:22.823849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:22.886477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 642/1310] 10.222.0.78 () {58 vars in 1061 bytes} [Fri Jun 17 08:43:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:22.895841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34138f-5329-4314-9d84-19b2bd5c755b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:22.897624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9d34138f-5329-4314-9d84-19b2bd5c755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:23.014319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34138f-5329-4314-9d84-19b2bd5c755b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:23.094156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7614fa9-4d6a-4a94-ad65-a665ba7ff858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:23.094832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7614fa9-4d6a-4a94-ad65-a665ba7ff858 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:23.095111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7614fa9-4d6a-4a94-ad65-a665ba7ff858 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:23.095408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7614fa9-4d6a-4a94-ad65-a665ba7ff858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:23.097049 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a7614fa9-4d6a-4a94-ad65-a665ba7ff858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:23.154788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:23.213316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7614fa9-4d6a-4a94-ad65-a665ba7ff858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:23.214761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7614fa9-4d6a-4a94-ad65-a665ba7ff858 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:23.237132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 669/1311] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:43:25.716801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03318bc0-38cb-4151-a526-f291f9c7b357 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:25.717307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03318bc0-38cb-4151-a526-f291f9c7b357 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:25.717307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03318bc0-38cb-4151-a526-f291f9c7b357 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:25.718662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 643/1312] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:25.724656 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6af7fe-76c0-4c4a-bc58-fdda8af52c6b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:25.725207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6af7fe-76c0-4c4a-bc58-fdda8af52c6b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:25.725207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6af7fe-76c0-4c4a-bc58-fdda8af52c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:25.803035 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3c6af7fe-76c0-4c4a-bc58-fdda8af52c6b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:25.804353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3c6af7fe-76c0-4c4a-bc58-fdda8af52c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:25.924760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 670/1313] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:25.981212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807362c3-02bc-4c56-abb4-3aaa165670b9 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:25.981438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807362c3-02bc-4c56-abb4-3aaa165670b9 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:25.981714 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807362c3-02bc-4c56-abb4-3aaa165670b9 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:25.983166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 644/1314] 10.222.0.78 () {54 vars in 964 bytes} [Fri Jun 17 08:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:25.990590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a470ebb-3a26-42f6-8fa4-ae5061c4db86 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:25.990879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a470ebb-3a26-42f6-8fa4-ae5061c4db86 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:25.991159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a470ebb-3a26-42f6-8fa4-ae5061c4db86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:26.002444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:26.076400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-0a470ebb-3a26-42f6-8fa4-ae5061c4db86 None None] MFA Rules not processed for user `024e0e53cfdb42e88dfdfde7a79e8c75`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:26.077623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0a470ebb-3a26-42f6-8fa4-ae5061c4db86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:26.154440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 671/1315] 10.222.0.78 () {58 vars in 1061 bytes} [Fri Jun 17 08:43:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:26.163608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807362c3-02bc-4c56-abb4-3aaa165670b9 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:26.165157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-807362c3-02bc-4c56-abb4-3aaa165670b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:26.272475 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807362c3-02bc-4c56-abb4-3aaa165670b9 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:26.350698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:26.353234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67343758-c6d2-4d21-b794-c221eea1f78e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:26.353924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343758-c6d2-4d21-b794-c221eea1f78e service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:26.354205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343758-c6d2-4d21-b794-c221eea1f78e service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:26.354485 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343758-c6d2-4d21-b794-c221eea1f78e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:26.356303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-67343758-c6d2-4d21-b794-c221eea1f78e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:26.470508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67343758-c6d2-4d21-b794-c221eea1f78e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:26.471985 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67343758-c6d2-4d21-b794-c221eea1f78e service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:26.490445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 645/1316] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:29.420013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e7f6-341b-4d53-9148-7485c1a70c8f None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:29.420643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e7f6-341b-4d53-9148-7485c1a70c8f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:29.420791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e7f6-341b-4d53-9148-7485c1a70c8f None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:29.422582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 672/1317] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:29.430664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0824f9d-f8ec-488e-b0b2-cb6155e410c6 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:29.431330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0824f9d-f8ec-488e-b0b2-cb6155e410c6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:29.431330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0824f9d-f8ec-488e-b0b2-cb6155e410c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:29.501281 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d0824f9d-f8ec-488e-b0b2-cb6155e410c6 None None] MFA Rules not processed for user `d9586b808f424d84881b2efb78ae761f`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:29.502538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d0824f9d-f8ec-488e-b0b2-cb6155e410c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:29.555017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:29.598338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 646/1318] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:29.638120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e7f6-341b-4d53-9148-7485c1a70c8f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:29.639801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-cdc5e7f6-341b-4d53-9148-7485c1a70c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:29.745705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e7f6-341b-4d53-9148-7485c1a70c8f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:29.748654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:29.820791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fcaba-dafe-4e57-80a0-ff56d145b6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:29.821477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fcaba-dafe-4e57-80a0-ff56d145b6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:29.821768 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fcaba-dafe-4e57-80a0-ff56d145b6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:29.822055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fcaba-dafe-4e57-80a0-ff56d145b6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:29.823994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d45fcaba-dafe-4e57-80a0-ff56d145b6f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:29.933954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fcaba-dafe-4e57-80a0-ff56d145b6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:29.935486 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fcaba-dafe-4e57-80a0-ff56d145b6f1 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:29.954989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 673/1319] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:32.913029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500ec7a-47d7-4b29-ae79-479be153db11 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:32.913610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500ec7a-47d7-4b29-ae79-479be153db11 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:32.913610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500ec7a-47d7-4b29-ae79-479be153db11 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:32.915089 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 647/1320] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:32.921437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22fccb-0224-438e-a537-8dfaa486a38b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:32.921939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22fccb-0224-438e-a537-8dfaa486a38b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:32.922046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22fccb-0224-438e-a537-8dfaa486a38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:32.966915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:32.996331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-5b22fccb-0224-438e-a537-8dfaa486a38b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:32.997578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-5b22fccb-0224-438e-a537-8dfaa486a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:33.096528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 674/1321] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:33.136125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500ec7a-47d7-4b29-ae79-479be153db11 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:33.137687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1500ec7a-47d7-4b29-ae79-479be153db11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:33.247106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500ec7a-47d7-4b29-ae79-479be153db11 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:33.323941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df6395-688f-45ce-8f7f-1cc07e64d025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:33.324592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df6395-688f-45ce-8f7f-1cc07e64d025 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:33.324873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df6395-688f-45ce-8f7f-1cc07e64d025 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:33.325147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df6395-688f-45ce-8f7f-1cc07e64d025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:33.326832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f5df6395-688f-45ce-8f7f-1cc07e64d025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:33.334431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:33.437664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df6395-688f-45ce-8f7f-1cc07e64d025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:33.439106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df6395-688f-45ce-8f7f-1cc07e64d025 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:33.458751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 648/1322] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:43:36.605905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584454-cf6b-4955-882d-6b48d0b229e6 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:36.606417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584454-cf6b-4955-882d-6b48d0b229e6 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:36.606417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07584454-cf6b-4955-882d-6b48d0b229e6 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:36.607786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 675/1323] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:36.613302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5a41-de98-48e6-a404-e7f902336581 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:36.613773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5a41-de98-48e6-a404-e7f902336581 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:36.613997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5a41-de98-48e6-a404-e7f902336581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:36.687176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b28d5a41-de98-48e6-a404-e7f902336581 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:36.688436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b28d5a41-de98-48e6-a404-e7f902336581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:36.750524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:36.799367 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 649/1324] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:36.837250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07584454-cf6b-4955-882d-6b48d0b229e6 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:36.838833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-07584454-cf6b-4955-882d-6b48d0b229e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:36.968279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07584454-cf6b-4955-882d-6b48d0b229e6 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:36.982267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:37.047641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc406c5-6c87-4aa2-a1c7-d92fe4800821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:37.048299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc406c5-6c87-4aa2-a1c7-d92fe4800821 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:37.048582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc406c5-6c87-4aa2-a1c7-d92fe4800821 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:37.048857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc406c5-6c87-4aa2-a1c7-d92fe4800821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:37.050511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0bc406c5-6c87-4aa2-a1c7-d92fe4800821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:37.160883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc406c5-6c87-4aa2-a1c7-d92fe4800821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:37.162373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc406c5-6c87-4aa2-a1c7-d92fe4800821 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:37.181462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 676/1325] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:39.391783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faae06-3e9a-4ae8-8171-76927fa2f3b4 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:39.392315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faae06-3e9a-4ae8-8171-76927fa2f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:39.392315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faae06-3e9a-4ae8-8171-76927fa2f3b4 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:39.393617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 650/1326] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:39.398747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af2e5a-411e-4c3d-a987-8ebe2a0d95ca None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:39.399167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af2e5a-411e-4c3d-a987-8ebe2a0d95ca None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:39.399311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af2e5a-411e-4c3d-a987-8ebe2a0d95ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:39.449349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:39.468031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-34af2e5a-411e-4c3d-a987-8ebe2a0d95ca None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:39.472894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-34af2e5a-411e-4c3d-a987-8ebe2a0d95ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:39.565540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 677/1327] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:39.602666 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faae06-3e9a-4ae8-8171-76927fa2f3b4 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:39.604875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-12faae06-3e9a-4ae8-8171-76927fa2f3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:39.711146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faae06-3e9a-4ae8-8171-76927fa2f3b4 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:39.787118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83e1bf-e835-4ecc-804c-479df068717e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:39.787816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83e1bf-e835-4ecc-804c-479df068717e service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:39.788105 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83e1bf-e835-4ecc-804c-479df068717e service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:39.788385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83e1bf-e835-4ecc-804c-479df068717e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:39.790302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1e83e1bf-e835-4ecc-804c-479df068717e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:39.811484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:39.912680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83e1bf-e835-4ecc-804c-479df068717e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:39.914227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83e1bf-e835-4ecc-804c-479df068717e service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:39.935178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 651/1328] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:42.130984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57680958-422c-42ba-9e72-dfbdb370635b None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:42.131575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57680958-422c-42ba-9e72-dfbdb370635b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:42.131674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57680958-422c-42ba-9e72-dfbdb370635b None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:42.133144 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 678/1329] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:42.139122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b5e9-44c2-4c93-9590-043b9c6a7c25 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:42.139690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b5e9-44c2-4c93-9590-043b9c6a7c25 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:42.139790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b5e9-44c2-4c93-9590-043b9c6a7c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:42.206854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d3c9b5e9-44c2-4c93-9590-043b9c6a7c25 None None] MFA Rules not processed for user `d9586b808f424d84881b2efb78ae761f`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:42.208165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d3c9b5e9-44c2-4c93-9590-043b9c6a7c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:42.276182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:42.310929 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 652/1330] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:42.350388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57680958-422c-42ba-9e72-dfbdb370635b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:42.352056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-57680958-422c-42ba-9e72-dfbdb370635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:42.460031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57680958-422c-42ba-9e72-dfbdb370635b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:42.480927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:42.534700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93aa8e-f129-4375-a7c3-efc14ea369d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:42.535386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93aa8e-f129-4375-a7c3-efc14ea369d8 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:42.535881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93aa8e-f129-4375-a7c3-efc14ea369d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:42.536356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93aa8e-f129-4375-a7c3-efc14ea369d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:42.538205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-bc93aa8e-f129-4375-a7c3-efc14ea369d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:42.670625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93aa8e-f129-4375-a7c3-efc14ea369d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:42.672116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93aa8e-f129-4375-a7c3-efc14ea369d8 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:42.691726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 679/1331] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:45.381641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314439c1-1c29-4328-87a4-f38d5bfd8bfa None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:45.382210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314439c1-1c29-4328-87a4-f38d5bfd8bfa None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:45.382210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314439c1-1c29-4328-87a4-f38d5bfd8bfa None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:45.383655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 653/1332] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:45.389558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43778ace-4e62-40a7-aa70-56ff669e79dd None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:45.389985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43778ace-4e62-40a7-aa70-56ff669e79dd None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:45.390162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43778ace-4e62-40a7-aa70-56ff669e79dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:45.458153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:45.461094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-43778ace-4e62-40a7-aa70-56ff669e79dd None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:45.462531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-43778ace-4e62-40a7-aa70-56ff669e79dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:45.559307 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 680/1333] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:45.595414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314439c1-1c29-4328-87a4-f38d5bfd8bfa None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:45.597000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-314439c1-1c29-4328-87a4-f38d5bfd8bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:45.702447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314439c1-1c29-4328-87a4-f38d5bfd8bfa None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:45.777288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a0f48-f8ba-4db7-80c6-04922080a2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:45.777936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a0f48-f8ba-4db7-80c6-04922080a2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:45.778214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a0f48-f8ba-4db7-80c6-04922080a2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:45.778486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a0f48-f8ba-4db7-80c6-04922080a2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:45.780218 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-441a0f48-f8ba-4db7-80c6-04922080a2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:45.806623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:45.891275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a0f48-f8ba-4db7-80c6-04922080a2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:45.892735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a0f48-f8ba-4db7-80c6-04922080a2d1 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:45.911962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 654/1334] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:48.095688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6935c-cdff-46cc-bf6d-20b01fdb6eaa None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:48.096258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6935c-cdff-46cc-bf6d-20b01fdb6eaa None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:48.096258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6935c-cdff-46cc-bf6d-20b01fdb6eaa None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:48.097592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 681/1335] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:48.102867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d6efc-d6ea-4ba7-bed4-ab02854d9ab1 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:48.103325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d6efc-d6ea-4ba7-bed4-ab02854d9ab1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:48.103541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d6efc-d6ea-4ba7-bed4-ab02854d9ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:48.167235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c16d6efc-d6ea-4ba7-bed4-ab02854d9ab1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:48.168732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c16d6efc-d6ea-4ba7-bed4-ab02854d9ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:48.242646 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:48.265654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 655/1336] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:48.305039 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6935c-cdff-46cc-bf6d-20b01fdb6eaa None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:48.307210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-cec6935c-cdff-46cc-bf6d-20b01fdb6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:48.408662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6935c-cdff-46cc-bf6d-20b01fdb6eaa None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:48.437106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:48.483654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf873fe1-3ab0-4c0a-806b-34fd386a3bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:48.484305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf873fe1-3ab0-4c0a-806b-34fd386a3bae service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:48.484585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf873fe1-3ab0-4c0a-806b-34fd386a3bae service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:48.484863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf873fe1-3ab0-4c0a-806b-34fd386a3bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:48.486526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-cf873fe1-3ab0-4c0a-806b-34fd386a3bae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:48.596997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf873fe1-3ab0-4c0a-806b-34fd386a3bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:48.598464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf873fe1-3ab0-4c0a-806b-34fd386a3bae service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:48.618003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 682/1337] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:51.348028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b155a9b-dfc4-46bd-b502-5476ab513037 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:51.348626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b155a9b-dfc4-46bd-b502-5476ab513037 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:51.348626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b155a9b-dfc4-46bd-b502-5476ab513037 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:51.349969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 656/1338] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:51.355319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee55236-d562-4df3-a0ae-a6e1a6943138 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:51.355758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee55236-d562-4df3-a0ae-a6e1a6943138 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:51.355906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee55236-d562-4df3-a0ae-a6e1a6943138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:51.420456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-eee55236-d562-4df3-a0ae-a6e1a6943138 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:51.421640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-eee55236-d562-4df3-a0ae-a6e1a6943138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:51.429555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:51.516648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 683/1339] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:51.551319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b155a9b-dfc4-46bd-b502-5476ab513037 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:51.552873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3b155a9b-dfc4-46bd-b502-5476ab513037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:51.660701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b155a9b-dfc4-46bd-b502-5476ab513037 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:51.737339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64155-9e41-438d-ade4-7d9f5533dc63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:51.738033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64155-9e41-438d-ade4-7d9f5533dc63 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:51.738318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64155-9e41-438d-ade4-7d9f5533dc63 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:51.738597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64155-9e41-438d-ade4-7d9f5533dc63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:51.740286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d3d64155-9e41-438d-ade4-7d9f5533dc63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:51.778334 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:51.851907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d64155-9e41-438d-ade4-7d9f5533dc63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:51.853531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d64155-9e41-438d-ade4-7d9f5533dc63 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:51.871309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 657/1340] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:43:56.300733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d55036-299f-4bf9-a181-7ab2b075e5a0 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:56.301254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d55036-299f-4bf9-a181-7ab2b075e5a0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:56.301339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d55036-299f-4bf9-a181-7ab2b075e5a0 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:56.302948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 684/1341] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:43:56.309074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d5faf-ce34-4192-9172-f8b7f77029c1 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:56.309512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d5faf-ce34-4192-9172-f8b7f77029c1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:56.309606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d5faf-ce34-4192-9172-f8b7f77029c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:56.383627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ae4d5faf-ce34-4192-9172-f8b7f77029c1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:43:56.385400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ae4d5faf-ce34-4192-9172-f8b7f77029c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:56.486841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:43:56.500508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 658/1342] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:43:56.539645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d55036-299f-4bf9-a181-7ab2b075e5a0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:43:56.542084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-45d55036-299f-4bf9-a181-7ab2b075e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:43:56.641309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d55036-299f-4bf9-a181-7ab2b075e5a0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:43:56.644936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54b515-3c76-4968-9abd-656469bf24ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:43:56.645580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54b515-3c76-4968-9abd-656469bf24ab service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:43:56.645864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54b515-3c76-4968-9abd-656469bf24ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:43:56.646144 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54b515-3c76-4968-9abd-656469bf24ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:43:56.655412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54b515-3c76-4968-9abd-656469bf24ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:43:56.656848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54b515-3c76-4968-9abd-656469bf24ab service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:43:56.666278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 685/1343] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:00.214807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d4d8e-7792-410f-b49b-30665b15b80e None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:00.215516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d4d8e-7792-410f-b49b-30665b15b80e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:00.215516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d4d8e-7792-410f-b49b-30665b15b80e None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:00.216769 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 659/1344] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:00.222146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fc91c-45bb-4820-8e60-0dc5dfd6cd15 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:00.222591 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fc91c-45bb-4820-8e60-0dc5dfd6cd15 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:00.222840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fc91c-45bb-4820-8e60-0dc5dfd6cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:00.251681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-e12fc91c-45bb-4820-8e60-0dc5dfd6cd15 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:00.252912 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e12fc91c-45bb-4820-8e60-0dc5dfd6cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:00.283410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:00.334484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 686/1345] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:00.372245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d4d8e-7792-410f-b49b-30665b15b80e None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:00.382900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d4d8e-7792-410f-b49b-30665b15b80e None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:00.387168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f72688-1f46-4ea8-a028-ee721084b7e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:00.387858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f72688-1f46-4ea8-a028-ee721084b7e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:00.388144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f72688-1f46-4ea8-a028-ee721084b7e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:00.388422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f72688-1f46-4ea8-a028-ee721084b7e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:00.397479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f72688-1f46-4ea8-a028-ee721084b7e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:00.398912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f72688-1f46-4ea8-a028-ee721084b7e4 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:00.408924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 660/1346] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:05.032363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5668248-8fe3-4f77-aa72-7fa18ead97ef None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:05.032924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5668248-8fe3-4f77-aa72-7fa18ead97ef None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:05.032924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5668248-8fe3-4f77-aa72-7fa18ead97ef None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:05.034259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 687/1347] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:05.040487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c386b7-6e0b-4479-a486-f239c485bab4 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:05.040971 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c386b7-6e0b-4479-a486-f239c485bab4 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:05.041095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c386b7-6e0b-4479-a486-f239c485bab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:05.060107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-53c386b7-6e0b-4479-a486-f239c485bab4 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:05.061320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-53c386b7-6e0b-4479-a486-f239c485bab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:05.069964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 661/1348] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:05.109466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5668248-8fe3-4f77-aa72-7fa18ead97ef None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:05.121791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5668248-8fe3-4f77-aa72-7fa18ead97ef None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:05.125697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720a1c6-33d3-414f-895c-d8a4d4e3c806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:05.126374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a1c6-33d3-414f-895c-d8a4d4e3c806 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:05.126659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a1c6-33d3-414f-895c-d8a4d4e3c806 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:05.126938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720a1c6-33d3-414f-895c-d8a4d4e3c806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:05.138305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720a1c6-33d3-414f-895c-d8a4d4e3c806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:05.139845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720a1c6-33d3-414f-895c-d8a4d4e3c806 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:05.151481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 688/1349] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:10.267264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530c01-882f-436a-846b-fcd88e913749 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:10.267264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530c01-882f-436a-846b-fcd88e913749 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:10.267264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530c01-882f-436a-846b-fcd88e913749 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:10.267264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 662/1350] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:10.272762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff415b1-ad85-482f-b147-0db8d252054b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:10.273533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff415b1-ad85-482f-b147-0db8d252054b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:10.274570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff415b1-ad85-482f-b147-0db8d252054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:10.454730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-bff415b1-ad85-482f-b147-0db8d252054b None None] MFA Rules not processed for user `f79f43c31f5346d5b1e6ae6ff8c511a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:10.455961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-bff415b1-ad85-482f-b147-0db8d252054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:10.539453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 689/1351] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:44:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:14.951462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5be4-ba97-483f-baf8-cf90ec7d881e None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:14.952408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5be4-ba97-483f-baf8-cf90ec7d881e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:14.952855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5be4-ba97-483f-baf8-cf90ec7d881e None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:14.954448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 663/1352] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:14.959979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62f4da-4510-4d31-b1b6-5e14514cc31b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:14.961027 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62f4da-4510-4d31-b1b6-5e14514cc31b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:14.968536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62f4da-4510-4d31-b1b6-5e14514cc31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:14.983213 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-bc62f4da-4510-4d31-b1b6-5e14514cc31b None None] MFA Rules not processed for user `f79f43c31f5346d5b1e6ae6ff8c511a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:14.985203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-bc62f4da-4510-4d31-b1b6-5e14514cc31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:14.996261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 690/1353] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:44:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:15.054527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=13 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:16.409227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58c7d-d6b1-4af4-b01e-6518aa4240c5 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:16.409847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58c7d-d6b1-4af4-b01e-6518aa4240c5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:16.409847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58c7d-d6b1-4af4-b01e-6518aa4240c5 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:16.411443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 664/1354] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:16.416968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cf6a6-563c-4ec7-b56c-134fc425f6d5 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:16.417430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cf6a6-563c-4ec7-b56c-134fc425f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:16.417535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cf6a6-563c-4ec7-b56c-134fc425f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:16.437025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-931cf6a6-563c-4ec7-b56c-134fc425f6d5 None None] MFA Rules not processed for user `f79f43c31f5346d5b1e6ae6ff8c511a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:16.438205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-931cf6a6-563c-4ec7-b56c-134fc425f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:16.447076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 691/1355] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:44:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:20.254451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f19e-b229-4472-ae51-307071dd3327 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:20.254984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f19e-b229-4472-ae51-307071dd3327 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:20.255380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f19e-b229-4472-ae51-307071dd3327 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:20.256856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 665/1356] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:20.262272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3453a8-ac93-477f-b136-d1774b002163 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:20.262740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3453a8-ac93-477f-b136-d1774b002163 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:20.262824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3453a8-ac93-477f-b136-d1774b002163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:20.281708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-dd3453a8-ac93-477f-b136-d1774b002163 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:20.283107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-dd3453a8-ac93-477f-b136-d1774b002163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:20.292639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 692/1357] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:20.347744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c413e1e-ec6a-4f88-ae39-e6583dabae64 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:20.348411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c413e1e-ec6a-4f88-ae39-e6583dabae64 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:20.349285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c413e1e-ec6a-4f88-ae39-e6583dabae64 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:20.351222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 666/1358] 10.222.0.78 () {54 vars in 961 bytes} [Fri Jun 17 08:44:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:20.359518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd027384-8371-46c5-95d9-83ae88eedd07 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:20.372406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd027384-8371-46c5-95d9-83ae88eedd07 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:20.372406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd027384-8371-46c5-95d9-83ae88eedd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:20.406628 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:20.416379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-dd027384-8371-46c5-95d9-83ae88eedd07 None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:20.417805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-dd027384-8371-46c5-95d9-83ae88eedd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:20.509120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 693/1359] 10.222.0.78 () {58 vars in 1058 bytes} [Fri Jun 17 08:44:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:44:20.516970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c413e1e-ec6a-4f88-ae39-e6583dabae64 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:20.533672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c413e1e-ec6a-4f88-ae39-e6583dabae64 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:20.540669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4201f5-dab0-4dff-9207-a0deca4223bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:20.544496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4201f5-dab0-4dff-9207-a0deca4223bc service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:20.544496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4201f5-dab0-4dff-9207-a0deca4223bc service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:20.544496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4201f5-dab0-4dff-9207-a0deca4223bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:20.551481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4201f5-dab0-4dff-9207-a0deca4223bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:20.553285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4201f5-dab0-4dff-9207-a0deca4223bc service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:20.564224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 667/1360] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:22.938723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de190-336b-4e82-8752-027add4113f5 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:22.939230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de190-336b-4e82-8752-027add4113f5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:22.939230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de190-336b-4e82-8752-027add4113f5 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:22.940856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 694/1361] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:22.946217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d4347-e5f6-4072-9b81-a5ffef707e5a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:22.946750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d4347-e5f6-4072-9b81-a5ffef707e5a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:22.946750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d4347-e5f6-4072-9b81-a5ffef707e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:22.965465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ce6d4347-e5f6-4072-9b81-a5ffef707e5a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:22.966680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ce6d4347-e5f6-4072-9b81-a5ffef707e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:22.974661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 668/1362] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:23.022554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389de190-336b-4e82-8752-027add4113f5 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:23.038643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389de190-336b-4e82-8752-027add4113f5 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:23.045476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144feab-3410-4deb-8490-acd328f13a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:23.046159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144feab-3410-4deb-8490-acd328f13a03 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:23.046446 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144feab-3410-4deb-8490-acd328f13a03 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:23.046730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144feab-3410-4deb-8490-acd328f13a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:23.056522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144feab-3410-4deb-8490-acd328f13a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:23.058199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144feab-3410-4deb-8490-acd328f13a03 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:23.069312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 695/1363] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:25.674622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71a0fa-5337-4c62-973e-ec36671d8b42 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:25.675175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71a0fa-5337-4c62-973e-ec36671d8b42 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:25.675175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71a0fa-5337-4c62-973e-ec36671d8b42 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:25.676877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 669/1364] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:25.682021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81f25a-3012-4f00-b39d-3fae1644017f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:25.682445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81f25a-3012-4f00-b39d-3fae1644017f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:25.682571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81f25a-3012-4f00-b39d-3fae1644017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:25.700911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-0b81f25a-3012-4f00-b39d-3fae1644017f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:25.702103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0b81f25a-3012-4f00-b39d-3fae1644017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:25.709891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 696/1365] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:25.761610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff185b18-e95a-4c33-ba51-bc121681c142 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:25.761899 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff185b18-e95a-4c33-ba51-bc121681c142 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:25.762184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff185b18-e95a-4c33-ba51-bc121681c142 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:25.763643 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 670/1366] 10.222.0.78 () {54 vars in 961 bytes} [Fri Jun 17 08:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:25.769184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6f75-9c69-4eb9-a5a0-93b9117c5892 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:25.769469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6f75-9c69-4eb9-a5a0-93b9117c5892 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:25.769754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f6f75-9c69-4eb9-a5a0-93b9117c5892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:25.787648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-301f6f75-9c69-4eb9-a5a0-93b9117c5892 None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:25.788821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-301f6f75-9c69-4eb9-a5a0-93b9117c5892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:25.797967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 697/1367] 10.222.0.78 () {58 vars in 1058 bytes} [Fri Jun 17 08:44:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:25.807195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff185b18-e95a-4c33-ba51-bc121681c142 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:25.827841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff185b18-e95a-4c33-ba51-bc121681c142 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:25.833286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379fe91-1b64-4fc0-b142-6aa76b12b73e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:25.833930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379fe91-1b64-4fc0-b142-6aa76b12b73e service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:25.834215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379fe91-1b64-4fc0-b142-6aa76b12b73e service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:25.834488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379fe91-1b64-4fc0-b142-6aa76b12b73e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:25.843225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379fe91-1b64-4fc0-b142-6aa76b12b73e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:25.844843 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379fe91-1b64-4fc0-b142-6aa76b12b73e service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:25.862803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 671/1368] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:28.303076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96785eb9-b86b-4e34-9063-7d4696e8167f None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:28.303630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96785eb9-b86b-4e34-9063-7d4696e8167f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:28.303716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96785eb9-b86b-4e34-9063-7d4696e8167f None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:28.305828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 698/1369] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:28.310783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2de642-a8cf-4de6-bd46-9ae4f57c1e52 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:28.311184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2de642-a8cf-4de6-bd46-9ae4f57c1e52 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:28.311378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2de642-a8cf-4de6-bd46-9ae4f57c1e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:28.331922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-1b2de642-a8cf-4de6-bd46-9ae4f57c1e52 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:28.333326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1b2de642-a8cf-4de6-bd46-9ae4f57c1e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:28.342852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 672/1370] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:28.388049 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96785eb9-b86b-4e34-9063-7d4696e8167f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:28.406669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96785eb9-b86b-4e34-9063-7d4696e8167f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:28.412470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408eea3-4399-444c-a081-9058f1a1cb36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:28.413179 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408eea3-4399-444c-a081-9058f1a1cb36 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:28.413668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408eea3-4399-444c-a081-9058f1a1cb36 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:28.414547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408eea3-4399-444c-a081-9058f1a1cb36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:28.423928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408eea3-4399-444c-a081-9058f1a1cb36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:28.425757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408eea3-4399-444c-a081-9058f1a1cb36 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:28.437202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 699/1371] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:28.545564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cca1f7-5961-4403-9c2b-efe66c123b2c None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:28.545860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cca1f7-5961-4403-9c2b-efe66c123b2c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:28.546134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cca1f7-5961-4403-9c2b-efe66c123b2c None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:28.547545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 673/1372] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:28.552985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082d9a-efc4-43e8-8e21-c9ec3fcfe8a4 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:28.553400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082d9a-efc4-43e8-8e21-c9ec3fcfe8a4 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:28.553721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082d9a-efc4-43e8-8e21-c9ec3fcfe8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:28.574030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-9f082d9a-efc4-43e8-8e21-c9ec3fcfe8a4 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:28.575227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9f082d9a-efc4-43e8-8e21-c9ec3fcfe8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:28.583621 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 700/1373] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:28.888943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709c991-48e4-4a1b-af29-534e749b5c07 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:28.888943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709c991-48e4-4a1b-af29-534e749b5c07 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:28.888943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709c991-48e4-4a1b-af29-534e749b5c07 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:28.890718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 674/1374] 10.222.0.78 () {54 vars in 963 bytes} [Fri Jun 17 08:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:28.894942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d43ba0-6e64-4e73-b13e-142e236773b7 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:28.895205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d43ba0-6e64-4e73-b13e-142e236773b7 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:28.895523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d43ba0-6e64-4e73-b13e-142e236773b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:28.947619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-94d43ba0-6e64-4e73-b13e-142e236773b7 None None] MFA Rules not processed for user `bd7feb1014c44c5a9b3832bad417b47c`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:28.948820 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-94d43ba0-6e64-4e73-b13e-142e236773b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:29.014515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 701/1375] 10.222.0.78 () {58 vars in 1060 bytes} [Fri Jun 17 08:44:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:29.022063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709c991-48e4-4a1b-af29-534e749b5c07 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:29.033662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709c991-48e4-4a1b-af29-534e749b5c07 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:29.037403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff397a-260c-484b-be3d-01e56af7b443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:29.038040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff397a-260c-484b-be3d-01e56af7b443 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:29.038319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff397a-260c-484b-be3d-01e56af7b443 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:29.038595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff397a-260c-484b-be3d-01e56af7b443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:29.049249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff397a-260c-484b-be3d-01e56af7b443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:29.050676 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff397a-260c-484b-be3d-01e56af7b443 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:29.060933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 675/1376] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:44:30.812609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba2ac-12a6-48b4-b49a-c85fb45e26b2 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:30.813309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba2ac-12a6-48b4-b49a-c85fb45e26b2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:30.813309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba2ac-12a6-48b4-b49a-c85fb45e26b2 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:30.814911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 702/1377] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:30.821622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ca44-05c9-4d13-badc-1a4b5ddb023a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:30.822201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ca44-05c9-4d13-badc-1a4b5ddb023a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:30.822201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14ca44-05c9-4d13-badc-1a4b5ddb023a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:30.842324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-1e14ca44-05c9-4d13-badc-1a4b5ddb023a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:30.843621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1e14ca44-05c9-4d13-badc-1a4b5ddb023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:30.853389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 676/1378] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:44:30.902032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba2ac-12a6-48b4-b49a-c85fb45e26b2 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:30.920034 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba2ac-12a6-48b4-b49a-c85fb45e26b2 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:30.926558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe30b4e-0092-4879-945d-c03f6d4ba708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:30.927504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe30b4e-0092-4879-945d-c03f6d4ba708 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:30.927799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe30b4e-0092-4879-945d-c03f6d4ba708 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:30.928079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe30b4e-0092-4879-945d-c03f6d4ba708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:30.938283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe30b4e-0092-4879-945d-c03f6d4ba708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:30.939980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe30b4e-0092-4879-945d-c03f6d4ba708 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:30.944796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:30.952349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 703/1379] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:33.606276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3e183-6f25-4caa-921d-32312cc16558 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:33.606935 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3e183-6f25-4caa-921d-32312cc16558 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:33.606935 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3e183-6f25-4caa-921d-32312cc16558 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:33.608371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 677/1380] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:33.614694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b0e8c-2115-4213-9aa1-851f827b9b1a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:33.615273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b0e8c-2115-4213-9aa1-851f827b9b1a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:33.615273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b0e8c-2115-4213-9aa1-851f827b9b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:33.635069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-ec5b0e8c-2115-4213-9aa1-851f827b9b1a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:33.636359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ec5b0e8c-2115-4213-9aa1-851f827b9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:33.644879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 704/1381] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:33.690402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3e183-6f25-4caa-921d-32312cc16558 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:33.706380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3e183-6f25-4caa-921d-32312cc16558 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:33.713316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2655d-9b21-4730-852c-039a736f33e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:33.714093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2655d-9b21-4730-852c-039a736f33e4 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:33.714500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2655d-9b21-4730-852c-039a736f33e4 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:33.715041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2655d-9b21-4730-852c-039a736f33e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:33.724396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2655d-9b21-4730-852c-039a736f33e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:33.726089 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2655d-9b21-4730-852c-039a736f33e4 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:33.736533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 678/1382] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:36.071903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfc3e0-adc0-4d26-b801-385814f9bd0c None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:36.072467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfc3e0-adc0-4d26-b801-385814f9bd0c None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:36.072467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfc3e0-adc0-4d26-b801-385814f9bd0c None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:36.073817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 705/1383] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:36.079205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa6323-aec8-40f3-a463-0dd247751f03 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:36.079654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa6323-aec8-40f3-a463-0dd247751f03 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:36.079791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa6323-aec8-40f3-a463-0dd247751f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:36.098945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c6fa6323-aec8-40f3-a463-0dd247751f03 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:36.100178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c6fa6323-aec8-40f3-a463-0dd247751f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:36.108536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 679/1384] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:36.150277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfc3e0-adc0-4d26-b801-385814f9bd0c None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:36.166012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfc3e0-adc0-4d26-b801-385814f9bd0c None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:36.171473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035600ee-56a7-4501-b391-69e0f95f2471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:36.172311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035600ee-56a7-4501-b391-69e0f95f2471 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:36.172506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035600ee-56a7-4501-b391-69e0f95f2471 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:36.173240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035600ee-56a7-4501-b391-69e0f95f2471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:36.182991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035600ee-56a7-4501-b391-69e0f95f2471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:36.184593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035600ee-56a7-4501-b391-69e0f95f2471 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:36.194730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 706/1385] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:38.395284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c366-952e-410e-a07c-8f55e7590d2b None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:38.395994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c366-952e-410e-a07c-8f55e7590d2b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:38.395994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c366-952e-410e-a07c-8f55e7590d2b None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:38.397328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 680/1386] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:44:38.403047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30147-a6ba-47c7-82fe-6255f6c36523 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:38.403513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30147-a6ba-47c7-82fe-6255f6c36523 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:38.403693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30147-a6ba-47c7-82fe-6255f6c36523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:38.423964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-01a30147-a6ba-47c7-82fe-6255f6c36523 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:38.425278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-01a30147-a6ba-47c7-82fe-6255f6c36523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:38.434825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 707/1387] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:38.483052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c366-952e-410e-a07c-8f55e7590d2b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:38.503083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c366-952e-410e-a07c-8f55e7590d2b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:38.510135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add36217-a705-4f77-83da-51113257c034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:38.511193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add36217-a705-4f77-83da-51113257c034 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:38.511807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add36217-a705-4f77-83da-51113257c034 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:38.512161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add36217-a705-4f77-83da-51113257c034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:38.523882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add36217-a705-4f77-83da-51113257c034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:38.526028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add36217-a705-4f77-83da-51113257c034 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:38.538417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 681/1388] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:41.050728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133f49-0d4e-447b-a859-3b559715e1f5 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:41.051267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133f49-0d4e-447b-a859-3b559715e1f5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:41.051413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133f49-0d4e-447b-a859-3b559715e1f5 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:41.052750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 708/1389] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:41.058226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb24b0-7a54-4fa6-93ac-b2c5bade99aa None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:41.058689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb24b0-7a54-4fa6-93ac-b2c5bade99aa None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:41.058779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb24b0-7a54-4fa6-93ac-b2c5bade99aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:41.077978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-adbb24b0-7a54-4fa6-93ac-b2c5bade99aa None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:41.079234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-adbb24b0-7a54-4fa6-93ac-b2c5bade99aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:41.088358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 682/1390] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:41.135837 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9133f49-0d4e-447b-a859-3b559715e1f5 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:41.154449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9133f49-0d4e-447b-a859-3b559715e1f5 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:41.161504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559fcb1-a683-44fa-8399-706e2775c929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:41.162308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559fcb1-a683-44fa-8399-706e2775c929 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:41.162665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559fcb1-a683-44fa-8399-706e2775c929 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:41.163019 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559fcb1-a683-44fa-8399-706e2775c929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:41.174574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559fcb1-a683-44fa-8399-706e2775c929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:41.176817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559fcb1-a683-44fa-8399-706e2775c929 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:41.189044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 709/1391] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:43.661622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f2278-787b-4f0e-91b4-b8bcca039251 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:43.662157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f2278-787b-4f0e-91b4-b8bcca039251 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:43.662346 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f2278-787b-4f0e-91b4-b8bcca039251 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:43.663995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 683/1392] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:43.669604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc057de-e325-4cdb-8054-2b26f23f0b15 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:43.670027 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc057de-e325-4cdb-8054-2b26f23f0b15 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:43.670202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc057de-e325-4cdb-8054-2b26f23f0b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:43.820811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-5fc057de-e325-4cdb-8054-2b26f23f0b15 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:43.822133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-5fc057de-e325-4cdb-8054-2b26f23f0b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:43.830523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 710/1393] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:43.874885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f2278-787b-4f0e-91b4-b8bcca039251 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:43.889829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f2278-787b-4f0e-91b4-b8bcca039251 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:43.895456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826e510-2017-46a2-a809-8326685d9f90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:43.896104 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826e510-2017-46a2-a809-8326685d9f90 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:43.896386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826e510-2017-46a2-a809-8326685d9f90 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:43.896665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826e510-2017-46a2-a809-8326685d9f90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:43.906279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826e510-2017-46a2-a809-8326685d9f90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:43.907893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826e510-2017-46a2-a809-8326685d9f90 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:43.918624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 684/1394] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:44.822444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ab9c-ffec-4356-b059-df34d998a9ad None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:44.823041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ab9c-ffec-4356-b059-df34d998a9ad None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:44.823041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931ab9c-ffec-4356-b059-df34d998a9ad None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:44.824384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 711/1395] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:44.829652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29006b-df5f-40a3-b871-ad0c71c6a4a7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:44.830075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29006b-df5f-40a3-b871-ad0c71c6a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:44.830209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29006b-df5f-40a3-b871-ad0c71c6a4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:44.849482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ad29006b-df5f-40a3-b871-ad0c71c6a4a7 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:44.850674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ad29006b-df5f-40a3-b871-ad0c71c6a4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:44.859153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 685/1396] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:44.913904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3f360-c173-446e-9e52-82600dfbc602 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:44.914190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3f360-c173-446e-9e52-82600dfbc602 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:44.914500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3f360-c173-446e-9e52-82600dfbc602 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:44.915937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 712/1397] 10.222.0.78 () {54 vars in 962 bytes} [Fri Jun 17 08:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:44.920906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92351748-ce00-4e38-9423-189ee2c632bf None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:44.921193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92351748-ce00-4e38-9423-189ee2c632bf None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:44.921468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92351748-ce00-4e38-9423-189ee2c632bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:44.971989 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-92351748-ce00-4e38-9423-189ee2c632bf None None] MFA Rules not processed for user `d039be6500e74ae3a6f30821c5c19a99`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:44.973187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-92351748-ce00-4e38-9423-189ee2c632bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:45.033812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 686/1398] 10.222.0.78 () {58 vars in 1059 bytes} [Fri Jun 17 08:44:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:45.041619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3f360-c173-446e-9e52-82600dfbc602 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:45.052409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3f360-c173-446e-9e52-82600dfbc602 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:45.056436 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf2a26-b115-409d-b76b-1616125bec0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd039be6500e74ae3a6f30821c5c19a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:45.057106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf2a26-b115-409d-b76b-1616125bec0b service glance] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:45.057392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf2a26-b115-409d-b76b-1616125bec0b service glance] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:45.057672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf2a26-b115-409d-b76b-1616125bec0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:45.067183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf2a26-b115-409d-b76b-1616125bec0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:45.068637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf2a26-b115-409d-b76b-1616125bec0b service glance] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:45.079048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 713/1399] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:46.008662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca8cd-15ff-4f90-9986-b58f4f34546c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:46.009348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca8cd-15ff-4f90-9986-b58f4f34546c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:46.009348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca8cd-15ff-4f90-9986-b58f4f34546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:46.014849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=93 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:46.062575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-77eca8cd-15ff-4f90-9986-b58f4f34546c None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:46.063804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-77eca8cd-15ff-4f90-9986-b58f4f34546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:46.133067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 687/1400] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:44:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:46.177456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a007-ab78-4784-9e57-ab14b6bea821 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:46.177922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a007-ab78-4784-9e57-ab14b6bea821 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:46.178148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a007-ab78-4784-9e57-ab14b6bea821 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:46.180178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 714/1401] 10.222.0.78 () {54 vars in 942 bytes} [Fri Jun 17 08:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:46.186130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3b1ea-7daf-46e6-b2bc-eb5081c9f4d7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:46.186612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3b1ea-7daf-46e6-b2bc-eb5081c9f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:46.186905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3b1ea-7daf-46e6-b2bc-eb5081c9f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:46.243424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8ea3b1ea-7daf-46e6-b2bc-eb5081c9f4d7 None None] MFA Rules not processed for user `46e2b769ba9b46778c96b2a04d45612d`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:46.244731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8ea3b1ea-7daf-46e6-b2bc-eb5081c9f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:46.310057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2103b-a505-4976-96d1-b9c29f79d670 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:46.310338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2103b-a505-4976-96d1-b9c29f79d670 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:46.310610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2103b-a505-4976-96d1-b9c29f79d670 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:46.312134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 715/1402] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:44:46.317397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5df25-8183-4e64-a333-751e810b771f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:46.317755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5df25-8183-4e64-a333-751e810b771f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:46.318104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5df25-8183-4e64-a333-751e810b771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:46.325968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 688/1403] 10.222.0.78 () {58 vars in 1039 bytes} [Fri Jun 17 08:44:46 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:46.334784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3b1ea-7daf-46e6-b2bc-eb5081c9f4d7 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:46.337207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-28b5df25-8183-4e64-a333-751e810b771f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:46.338413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-28b5df25-8183-4e64-a333-751e810b771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:46.344985 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3b1ea-7daf-46e6-b2bc-eb5081c9f4d7 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:46.346981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 716/1404] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:44:46.350351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c47709-239a-41f8-a64b-5f773d071057 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:46.350993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c47709-239a-41f8-a64b-5f773d071057 service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:46.351876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c47709-239a-41f8-a64b-5f773d071057 service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:46.352163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c47709-239a-41f8-a64b-5f773d071057 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:46.361153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c47709-239a-41f8-a64b-5f773d071057 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:46.362919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c47709-239a-41f8-a64b-5f773d071057 service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:46.371231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 689/1405] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:44:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 08:44:46.394652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5df25-8183-4e64-a333-751e810b771f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:46.408008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5df25-8183-4e64-a333-751e810b771f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:46.413324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dae4e-3a4d-437f-acfd-ffc5e3d22a73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:46.414101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dae4e-3a4d-437f-acfd-ffc5e3d22a73 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:46.414423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dae4e-3a4d-437f-acfd-ffc5e3d22a73 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:46.414701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dae4e-3a4d-437f-acfd-ffc5e3d22a73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:46.423015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dae4e-3a4d-437f-acfd-ffc5e3d22a73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:46.424619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dae4e-3a4d-437f-acfd-ffc5e3d22a73 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:46.434047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 717/1406] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:44:49.199572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92228a-aec2-4433-aeed-baeb8288e43e None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:49.200222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92228a-aec2-4433-aeed-baeb8288e43e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:49.200222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92228a-aec2-4433-aeed-baeb8288e43e None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:49.201498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 690/1407] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:44:49.207295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1242b6-7f79-4a7f-b630-d18645048ff2 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:49.207816 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1242b6-7f79-4a7f-b630-d18645048ff2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:49.208038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1242b6-7f79-4a7f-b630-d18645048ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:49.229457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-4e1242b6-7f79-4a7f-b630-d18645048ff2 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:44:49.230652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4e1242b6-7f79-4a7f-b630-d18645048ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:44:49.238675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 718/1408] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:44:49.299518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92228a-aec2-4433-aeed-baeb8288e43e None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:44:49.314765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92228a-aec2-4433-aeed-baeb8288e43e None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:44:49.322939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ec67-4785-44dc-88d0-2975166d2782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:44:49.323622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ec67-4785-44dc-88d0-2975166d2782 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:44:49.323905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ec67-4785-44dc-88d0-2975166d2782 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:44:49.324176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ec67-4785-44dc-88d0-2975166d2782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:44:49.333552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426ec67-4785-44dc-88d0-2975166d2782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:44:49.335470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426ec67-4785-44dc-88d0-2975166d2782 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:44:49.355046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 691/1409] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:44:59.224398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=40 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:44:59.343411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:11.392368 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527ade-0037-440d-a157-ca0a98f593c8 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:11.393008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527ade-0037-440d-a157-ca0a98f593c8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:11.393008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527ade-0037-440d-a157-ca0a98f593c8 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:11.394269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 719/1410] 10.222.0.78 () {54 vars in 918 bytes} [Fri Jun 17 08:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:11.399446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dd3b9-ac46-4aa3-8644-6d912bfac2f0 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:11.399959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dd3b9-ac46-4aa3-8644-6d912bfac2f0 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:11.400064 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dd3b9-ac46-4aa3-8644-6d912bfac2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:11.418328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-3b1dd3b9-ac46-4aa3-8644-6d912bfac2f0 None None] MFA Rules not processed for user `f79f43c31f5346d5b1e6ae6ff8c511a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:11.419569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3b1dd3b9-ac46-4aa3-8644-6d912bfac2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:11.427909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 692/1411] 10.222.0.78 () {58 vars in 1015 bytes} [Fri Jun 17 08:45:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:11.443249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb0b6-b3f9-4199-a71e-bbb2f30894f8 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:11.443568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb0b6-b3f9-4199-a71e-bbb2f30894f8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:11.443849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb0b6-b3f9-4199-a71e-bbb2f30894f8 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:11.446297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 720/1412] 10.222.0.78 () {54 vars in 918 bytes} [Fri Jun 17 08:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:11.450165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199a3e-3cfc-4b76-9036-b805aa7b4b34 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:11.450484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199a3e-3cfc-4b76-9036-b805aa7b4b34 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:11.450760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199a3e-3cfc-4b76-9036-b805aa7b4b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:11.469436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2a199a3e-3cfc-4b76-9036-b805aa7b4b34 None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:11.470627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2a199a3e-3cfc-4b76-9036-b805aa7b4b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:11.480660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 693/1413] 10.222.0.78 () {58 vars in 1015 bytes} [Fri Jun 17 08:45:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:14.116872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006764f5-c9a8-4db5-9d45-f11f2d56d806 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:14.117458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006764f5-c9a8-4db5-9d45-f11f2d56d806 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:14.117458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006764f5-c9a8-4db5-9d45-f11f2d56d806 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:14.118737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 721/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:14.124869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799839a-17d1-4a3d-9e1a-cd83abaa359c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:14.125326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799839a-17d1-4a3d-9e1a-cd83abaa359c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:14.125437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799839a-17d1-4a3d-9e1a-cd83abaa359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:14.143950 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-4799839a-17d1-4a3d-9e1a-cd83abaa359c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:14.145154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4799839a-17d1-4a3d-9e1a-cd83abaa359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:14.153156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 694/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:14.200237 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006764f5-c9a8-4db5-9d45-f11f2d56d806 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:14.216063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006764f5-c9a8-4db5-9d45-f11f2d56d806 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:14.221626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5ddd9-cb8c-49fb-9079-83c007925df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:14.222275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ddd9-cb8c-49fb-9079-83c007925df6 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:14.222557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ddd9-cb8c-49fb-9079-83c007925df6 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:14.222836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ddd9-cb8c-49fb-9079-83c007925df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:14.232244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5ddd9-cb8c-49fb-9079-83c007925df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:14.234186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5ddd9-cb8c-49fb-9079-83c007925df6 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:14.244795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 722/1416] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:15.223606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe41fda-1dee-4ee5-93bd-1ff5f7772b36 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:15.224179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe41fda-1dee-4ee5-93bd-1ff5f7772b36 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:15.224179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe41fda-1dee-4ee5-93bd-1ff5f7772b36 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:15.225536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 695/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:15.231005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fa82e-2bf4-4a51-9996-9dc3d6cbba8c None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:15.231533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fa82e-2bf4-4a51-9996-9dc3d6cbba8c None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:15.231653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fa82e-2bf4-4a51-9996-9dc3d6cbba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:15.250440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-796fa82e-2bf4-4a51-9996-9dc3d6cbba8c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:15.251746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-796fa82e-2bf4-4a51-9996-9dc3d6cbba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:15.260373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 723/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:15.428227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe41fda-1dee-4ee5-93bd-1ff5f7772b36 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:15.443655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe41fda-1dee-4ee5-93bd-1ff5f7772b36 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:15.449644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dd919-fe4f-4b8d-82fb-900e3dbfc3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:15.450347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dd919-fe4f-4b8d-82fb-900e3dbfc3a6 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:15.450564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dd919-fe4f-4b8d-82fb-900e3dbfc3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:15.450837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dd919-fe4f-4b8d-82fb-900e3dbfc3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:15.459664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dd919-fe4f-4b8d-82fb-900e3dbfc3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:15.461758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dd919-fe4f-4b8d-82fb-900e3dbfc3a6 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:15.471432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 696/1419] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:16.411918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650077cb-0ce2-4f0d-9136-d6205d0dafad None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:16.412501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650077cb-0ce2-4f0d-9136-d6205d0dafad None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:16.412501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650077cb-0ce2-4f0d-9136-d6205d0dafad None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:16.413835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 724/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:45:16.418953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63770190-a031-43ca-9401-fe22ef531d3a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:16.419421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63770190-a031-43ca-9401-fe22ef531d3a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:16.419546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63770190-a031-43ca-9401-fe22ef531d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:16.437331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-63770190-a031-43ca-9401-fe22ef531d3a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:16.438534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-63770190-a031-43ca-9401-fe22ef531d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:16.447511 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 697/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:16.602799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650077cb-0ce2-4f0d-9136-d6205d0dafad None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:16.616765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650077cb-0ce2-4f0d-9136-d6205d0dafad None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:16.622799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917bd27-0043-401f-a759-5765758eacd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:16.623468 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bd27-0043-401f-a759-5765758eacd9 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:16.623747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bd27-0043-401f-a759-5765758eacd9 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:16.624022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917bd27-0043-401f-a759-5765758eacd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:16.632793 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917bd27-0043-401f-a759-5765758eacd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:16.634483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917bd27-0043-401f-a759-5765758eacd9 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:16.644427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 725/1422] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:17.580480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d680ec-f5f9-4aad-9946-4792fb6e2dd8 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:17.581049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d680ec-f5f9-4aad-9946-4792fb6e2dd8 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:17.581049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d680ec-f5f9-4aad-9946-4792fb6e2dd8 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:17.582409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 698/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:17.588011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a57f60-e94d-4155-8202-a2a62fc005d3 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:17.588474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a57f60-e94d-4155-8202-a2a62fc005d3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:17.588587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a57f60-e94d-4155-8202-a2a62fc005d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:17.606817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-35a57f60-e94d-4155-8202-a2a62fc005d3 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:17.608064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-35a57f60-e94d-4155-8202-a2a62fc005d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:17.615738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 726/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:17.768149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d680ec-f5f9-4aad-9946-4792fb6e2dd8 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:17.782915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d680ec-f5f9-4aad-9946-4792fb6e2dd8 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:17.788316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3d1f8-d6b7-4cc4-a389-949c631db13f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:17.789606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3d1f8-d6b7-4cc4-a389-949c631db13f service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:17.789892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3d1f8-d6b7-4cc4-a389-949c631db13f service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:17.790164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3d1f8-d6b7-4cc4-a389-949c631db13f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:17.798653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3d1f8-d6b7-4cc4-a389-949c631db13f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:17.800262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3d1f8-d6b7-4cc4-a389-949c631db13f service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:17.809762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 699/1425] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:18.712719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad1ca3-f6e1-449e-9f06-aae66c9abe22 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:18.713261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad1ca3-f6e1-449e-9f06-aae66c9abe22 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:18.713261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad1ca3-f6e1-449e-9f06-aae66c9abe22 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:18.714515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 727/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:18.719423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363b2a-7c2d-438a-85f7-594fba578c73 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:18.719845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363b2a-7c2d-438a-85f7-594fba578c73 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:18.720024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363b2a-7c2d-438a-85f7-594fba578c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:18.738719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-88363b2a-7c2d-438a-85f7-594fba578c73 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:18.739963 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-88363b2a-7c2d-438a-85f7-594fba578c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:18.748517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 700/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:18.901721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad1ca3-f6e1-449e-9f06-aae66c9abe22 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:18.916465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad1ca3-f6e1-449e-9f06-aae66c9abe22 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:18.922045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df0513-0eb1-4030-b114-45497f9a795a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:18.922687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0513-0eb1-4030-b114-45497f9a795a service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:18.922969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0513-0eb1-4030-b114-45497f9a795a service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:18.923245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0513-0eb1-4030-b114-45497f9a795a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:18.932533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df0513-0eb1-4030-b114-45497f9a795a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:18.934157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df0513-0eb1-4030-b114-45497f9a795a service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:18.944155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 728/1428] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:19.880033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee594c6-5811-4824-9dff-09c51b7d8c7f None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:19.880617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee594c6-5811-4824-9dff-09c51b7d8c7f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:19.880617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee594c6-5811-4824-9dff-09c51b7d8c7f None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:19.881981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 701/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:19.887396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdac43-c08c-4dc8-a36a-5d5c6602765a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:19.887836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdac43-c08c-4dc8-a36a-5d5c6602765a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:19.887946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdac43-c08c-4dc8-a36a-5d5c6602765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:19.906195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-64fdac43-c08c-4dc8-a36a-5d5c6602765a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:19.907408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-64fdac43-c08c-4dc8-a36a-5d5c6602765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:19.915886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 729/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:20.067141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee594c6-5811-4824-9dff-09c51b7d8c7f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:20.082253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee594c6-5811-4824-9dff-09c51b7d8c7f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:20.087879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ad5c3-9663-4be8-af51-8dfc886ce92e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:20.088512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad5c3-9663-4be8-af51-8dfc886ce92e service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:20.088795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad5c3-9663-4be8-af51-8dfc886ce92e service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:20.089072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad5c3-9663-4be8-af51-8dfc886ce92e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:20.097349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ad5c3-9663-4be8-af51-8dfc886ce92e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:20.098925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ad5c3-9663-4be8-af51-8dfc886ce92e service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:20.108916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 702/1431] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:21.032236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33205cd4-3941-419f-90df-4df2f5d0aa95 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:21.032803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33205cd4-3941-419f-90df-4df2f5d0aa95 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:21.032803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33205cd4-3941-419f-90df-4df2f5d0aa95 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:21.034121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 730/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:21.039597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7e60f-6cfd-4130-8bcb-c773bcae8de1 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:21.040053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7e60f-6cfd-4130-8bcb-c773bcae8de1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:21.040200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7e60f-6cfd-4130-8bcb-c773bcae8de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:21.058331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f3d7e60f-6cfd-4130-8bcb-c773bcae8de1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:21.059589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f3d7e60f-6cfd-4130-8bcb-c773bcae8de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:21.068325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 703/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:21.221406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33205cd4-3941-419f-90df-4df2f5d0aa95 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:21.235906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33205cd4-3941-419f-90df-4df2f5d0aa95 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:21.241394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dd71d-79c9-4561-bef0-7f54a71a2514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:21.242678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dd71d-79c9-4561-bef0-7f54a71a2514 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:21.242960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dd71d-79c9-4561-bef0-7f54a71a2514 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:21.243265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dd71d-79c9-4561-bef0-7f54a71a2514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:21.252312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dd71d-79c9-4561-bef0-7f54a71a2514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:21.253957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dd71d-79c9-4561-bef0-7f54a71a2514 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:21.264790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 731/1434] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:22.205922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bd91d-09f2-4746-8b60-afb3853cb874 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:22.206457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bd91d-09f2-4746-8b60-afb3853cb874 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:22.206457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bd91d-09f2-4746-8b60-afb3853cb874 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:22.207793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 704/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:22.213149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3b412-b1d8-41c1-8b5f-589d559229ac None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:22.213613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3b412-b1d8-41c1-8b5f-589d559229ac None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:22.213713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3b412-b1d8-41c1-8b5f-589d559229ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:22.231475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1ea3b412-b1d8-41c1-8b5f-589d559229ac None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:22.232659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1ea3b412-b1d8-41c1-8b5f-589d559229ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:22.240435 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 732/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:22.392874 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bd91d-09f2-4746-8b60-afb3853cb874 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:22.407479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bd91d-09f2-4746-8b60-afb3853cb874 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:22.412841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e817f-1aa4-4f94-b519-282d64f0be79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:22.413476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e817f-1aa4-4f94-b519-282d64f0be79 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:22.414249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e817f-1aa4-4f94-b519-282d64f0be79 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:22.414518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e817f-1aa4-4f94-b519-282d64f0be79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:22.423155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e817f-1aa4-4f94-b519-282d64f0be79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:22.424787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e817f-1aa4-4f94-b519-282d64f0be79 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:22.435019 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 705/1437] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:23.392752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ff59a-8493-4584-a4e1-9db817042da1 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:23.393333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ff59a-8493-4584-a4e1-9db817042da1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:23.393333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ff59a-8493-4584-a4e1-9db817042da1 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:23.394657 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 733/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:23.400222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00155-0210-4879-bf95-68eaee7180ac None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:23.400638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00155-0210-4879-bf95-68eaee7180ac None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:23.400754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00155-0210-4879-bf95-68eaee7180ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:23.418350 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-0ee00155-0210-4879-bf95-68eaee7180ac None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:23.419569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0ee00155-0210-4879-bf95-68eaee7180ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:23.427180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 706/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:23.577954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ff59a-8493-4584-a4e1-9db817042da1 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:23.591902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ff59a-8493-4584-a4e1-9db817042da1 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:23.599822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750a684-38bd-4ff5-a73e-11c0111ba9e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:23.600484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750a684-38bd-4ff5-a73e-11c0111ba9e3 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:23.600767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750a684-38bd-4ff5-a73e-11c0111ba9e3 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:23.601108 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750a684-38bd-4ff5-a73e-11c0111ba9e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:23.610462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750a684-38bd-4ff5-a73e-11c0111ba9e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:23.612097 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750a684-38bd-4ff5-a73e-11c0111ba9e3 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:23.622505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 734/1440] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:25.671814 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53ad9-eef7-4d20-a9d1-44af3b42ddb7 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:25.672595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53ad9-eef7-4d20-a9d1-44af3b42ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:25.672595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca53ad9-eef7-4d20-a9d1-44af3b42ddb7 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:25.673795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 707/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:25.680670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88f01-25b9-4ab0-b69f-162cc1b7029c None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:25.681146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88f01-25b9-4ab0-b69f-162cc1b7029c None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:25.681271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88f01-25b9-4ab0-b69f-162cc1b7029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:25.720926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-37e88f01-25b9-4ab0-b69f-162cc1b7029c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:25.720926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-37e88f01-25b9-4ab0-b69f-162cc1b7029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:25.720926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 735/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:25.750504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca53ad9-eef7-4d20-a9d1-44af3b42ddb7 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:25.761944 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca53ad9-eef7-4d20-a9d1-44af3b42ddb7 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:25.765570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a83c47-f62d-4227-947a-9ffed925f851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:25.766211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a83c47-f62d-4227-947a-9ffed925f851 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:25.766494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a83c47-f62d-4227-947a-9ffed925f851 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:25.766771 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a83c47-f62d-4227-947a-9ffed925f851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:25.776183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a83c47-f62d-4227-947a-9ffed925f851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:25.777597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a83c47-f62d-4227-947a-9ffed925f851 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:25.787006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 708/1443] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:28.102927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fdc9a-9a13-4730-81da-0b47495ca306 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:28.103548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fdc9a-9a13-4730-81da-0b47495ca306 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:28.103671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fdc9a-9a13-4730-81da-0b47495ca306 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:28.104975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 736/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:28.110556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69230aec-4c1f-47bc-895b-1473a3f95597 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:28.111013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69230aec-4c1f-47bc-895b-1473a3f95597 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:28.111119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69230aec-4c1f-47bc-895b-1473a3f95597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:28.128780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-69230aec-4c1f-47bc-895b-1473a3f95597 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:28.129982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-69230aec-4c1f-47bc-895b-1473a3f95597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:28.137984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 709/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:28.178133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fdc9a-9a13-4730-81da-0b47495ca306 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:28.180138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f07fdc9a-9a13-4730-81da-0b47495ca306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:28.193145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fdc9a-9a13-4730-81da-0b47495ca306 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:28.197018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8123c-e7d8-417d-956c-ad1ad2737d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:28.197666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8123c-e7d8-417d-956c-ad1ad2737d02 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:28.197976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8123c-e7d8-417d-956c-ad1ad2737d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:28.198257 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8123c-e7d8-417d-956c-ad1ad2737d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:28.207575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8123c-e7d8-417d-956c-ad1ad2737d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:28.209001 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8123c-e7d8-417d-956c-ad1ad2737d02 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:28.219475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 737/1446] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:30.802020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d8f6-1415-4035-a8ec-ee413bc4a199 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:30.802596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d8f6-1415-4035-a8ec-ee413bc4a199 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:30.802596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52d8f6-1415-4035-a8ec-ee413bc4a199 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:30.804647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 710/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:30.810333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83760-215e-484a-ab65-6882c8edb0d8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:30.810839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83760-215e-484a-ab65-6882c8edb0d8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:30.810971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b83760-215e-484a-ab65-6882c8edb0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:30.836173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-51b83760-215e-484a-ab65-6882c8edb0d8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:30.837373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-51b83760-215e-484a-ab65-6882c8edb0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:30.845146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 738/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:30.884890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52d8f6-1415-4035-a8ec-ee413bc4a199 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:30.895681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52d8f6-1415-4035-a8ec-ee413bc4a199 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:30.899425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e697c6-c1be-4b6e-b449-08d7ef94d499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:30.900089 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e697c6-c1be-4b6e-b449-08d7ef94d499 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:30.900373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e697c6-c1be-4b6e-b449-08d7ef94d499 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:30.900653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e697c6-c1be-4b6e-b449-08d7ef94d499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:30.909660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e697c6-c1be-4b6e-b449-08d7ef94d499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:30.911083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e697c6-c1be-4b6e-b449-08d7ef94d499 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:30.921352 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 711/1449] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:33.186143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d473d-7b48-4a3f-8718-24cc46692a7b None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:33.186721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d473d-7b48-4a3f-8718-24cc46692a7b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:33.186721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d473d-7b48-4a3f-8718-24cc46692a7b None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:33.188084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 739/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:33.193539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccd28a-eead-45b7-bedb-b6cced9b7bbb None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:33.194010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccd28a-eead-45b7-bedb-b6cced9b7bbb None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:33.194119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccd28a-eead-45b7-bedb-b6cced9b7bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:33.212231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-fbccd28a-eead-45b7-bedb-b6cced9b7bbb None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:33.213423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-fbccd28a-eead-45b7-bedb-b6cced9b7bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:33.221176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 712/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:33.259256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d473d-7b48-4a3f-8718-24cc46692a7b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:33.270004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d473d-7b48-4a3f-8718-24cc46692a7b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:33.273937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c44f38-0cf6-4188-bd57-70a4d8e838eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:33.274579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44f38-0cf6-4188-bd57-70a4d8e838eb service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:33.274857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44f38-0cf6-4188-bd57-70a4d8e838eb service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:33.275129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c44f38-0cf6-4188-bd57-70a4d8e838eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:33.284005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c44f38-0cf6-4188-bd57-70a4d8e838eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:33.285433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c44f38-0cf6-4188-bd57-70a4d8e838eb service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:33.295434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 740/1452] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:35.512259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911a0b-bf5d-40e7-b66b-7d450d5a1276 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:35.512949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911a0b-bf5d-40e7-b66b-7d450d5a1276 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:35.512949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78911a0b-bf5d-40e7-b66b-7d450d5a1276 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:35.514214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 713/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:35.520006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da75c9-abf9-4a09-a97e-0c4ae679edde None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:35.520508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da75c9-abf9-4a09-a97e-0c4ae679edde None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:35.520645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da75c9-abf9-4a09-a97e-0c4ae679edde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:35.539737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-09da75c9-abf9-4a09-a97e-0c4ae679edde None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:35.540957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-09da75c9-abf9-4a09-a97e-0c4ae679edde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:35.549201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 741/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:35.588282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78911a0b-bf5d-40e7-b66b-7d450d5a1276 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:35.598886 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78911a0b-bf5d-40e7-b66b-7d450d5a1276 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:35.602948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72808f0-2e63-4952-9271-8aed4816e54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:35.603623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72808f0-2e63-4952-9271-8aed4816e54c service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:35.603905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72808f0-2e63-4952-9271-8aed4816e54c service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:35.604174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72808f0-2e63-4952-9271-8aed4816e54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:35.613417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72808f0-2e63-4952-9271-8aed4816e54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:35.614826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72808f0-2e63-4952-9271-8aed4816e54c service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:35.624161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 714/1455] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:37.785877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf415-6629-4296-8866-d0704f89da6c None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:37.786496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf415-6629-4296-8866-d0704f89da6c None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:37.786496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf415-6629-4296-8866-d0704f89da6c None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:37.787836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 742/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:37.793696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f182-c1af-443f-9227-a82144b3e0af None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:37.794135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f182-c1af-443f-9227-a82144b3e0af None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:37.794260 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f182-c1af-443f-9227-a82144b3e0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:37.812649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-91e3f182-c1af-443f-9227-a82144b3e0af None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:37.813838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-91e3f182-c1af-443f-9227-a82144b3e0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:37.822530 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 715/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:37.860412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bf415-6629-4296-8866-d0704f89da6c None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:37.872491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bf415-6629-4296-8866-d0704f89da6c None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:37.876334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17862c-16b0-4525-9b7b-5563fb20a6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:37.876981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17862c-16b0-4525-9b7b-5563fb20a6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:37.877283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17862c-16b0-4525-9b7b-5563fb20a6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:37.877557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17862c-16b0-4525-9b7b-5563fb20a6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:37.890332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17862c-16b0-4525-9b7b-5563fb20a6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:37.891827 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17862c-16b0-4525-9b7b-5563fb20a6d6 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:37.902138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 743/1458] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:40.086616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c0e1a-0ef1-46ee-acb0-4f28babf1c3b None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:40.087182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c0e1a-0ef1-46ee-acb0-4f28babf1c3b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:40.087182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c0e1a-0ef1-46ee-acb0-4f28babf1c3b None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:40.088576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 716/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:45:40.093747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e80d-7e8c-495c-bc1c-27a294555573 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:40.103199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e80d-7e8c-495c-bc1c-27a294555573 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:40.103199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86e80d-7e8c-495c-bc1c-27a294555573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:40.103199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=70 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:40.112346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-6f86e80d-7e8c-495c-bc1c-27a294555573 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:40.113521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6f86e80d-7e8c-495c-bc1c-27a294555573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:40.121367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 744/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:40.157959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c0e1a-0ef1-46ee-acb0-4f28babf1c3b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:40.164016 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=73 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:40.169717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c0e1a-0ef1-46ee-acb0-4f28babf1c3b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:40.173322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e889c-ce79-4dec-860e-8f5fd6d8d4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:40.173962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e889c-ce79-4dec-860e-8f5fd6d8d4fc service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:40.174247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e889c-ce79-4dec-860e-8f5fd6d8d4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:40.174527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e889c-ce79-4dec-860e-8f5fd6d8d4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:40.183579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e889c-ce79-4dec-860e-8f5fd6d8d4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:40.185023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e889c-ce79-4dec-860e-8f5fd6d8d4fc service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:40.195376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 717/1461] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:42.404353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4a04-7498-4ae6-b5ee-46fe3a83434d None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:42.404795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4a04-7498-4ae6-b5ee-46fe3a83434d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:42.404904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4a04-7498-4ae6-b5ee-46fe3a83434d None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:42.406247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 745/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:42.411401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dcf80-27c1-4574-9832-9a6a2fb44239 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:42.411780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dcf80-27c1-4574-9832-9a6a2fb44239 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:42.411965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dcf80-27c1-4574-9832-9a6a2fb44239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:42.429829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-dc2dcf80-27c1-4574-9832-9a6a2fb44239 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:42.431026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-dc2dcf80-27c1-4574-9832-9a6a2fb44239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:42.439287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 718/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:42.477219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4a04-7498-4ae6-b5ee-46fe3a83434d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:42.488969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4a04-7498-4ae6-b5ee-46fe3a83434d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:42.493014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36876ad1-4d8f-4120-8431-de1fc93bc6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:42.493643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876ad1-4d8f-4120-8431-de1fc93bc6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:42.493925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876ad1-4d8f-4120-8431-de1fc93bc6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:42.494199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876ad1-4d8f-4120-8431-de1fc93bc6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:42.502862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36876ad1-4d8f-4120-8431-de1fc93bc6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:42.504306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36876ad1-4d8f-4120-8431-de1fc93bc6d6 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:42.514111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 746/1464] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:44.650620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce01bc-6863-47fb-926b-cce4a1e0550a None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:44.651166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce01bc-6863-47fb-926b-cce4a1e0550a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:44.651166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce01bc-6863-47fb-926b-cce4a1e0550a None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:44.652580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 719/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:44.657774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ad363-ecc9-4aa7-8678-45001519c34a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:44.658184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ad363-ecc9-4aa7-8678-45001519c34a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:44.658361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ad363-ecc9-4aa7-8678-45001519c34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:44.675640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-329ad363-ecc9-4aa7-8678-45001519c34a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:44.676814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-329ad363-ecc9-4aa7-8678-45001519c34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:44.685016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 747/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:44.722352 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce01bc-6863-47fb-926b-cce4a1e0550a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:44.733250 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce01bc-6863-47fb-926b-cce4a1e0550a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:44.736807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad197f-00b1-482c-8d39-822f587a295f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:44.737442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad197f-00b1-482c-8d39-822f587a295f service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:44.737727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad197f-00b1-482c-8d39-822f587a295f service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:44.738006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad197f-00b1-482c-8d39-822f587a295f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:44.747637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad197f-00b1-482c-8d39-822f587a295f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:44.749104 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad197f-00b1-482c-8d39-822f587a295f service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:44.759424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 720/1467] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:46.901768 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac1525-b7e8-4773-8c3f-5527f4d6b162 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:46.902344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac1525-b7e8-4773-8c3f-5527f4d6b162 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:46.902344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac1525-b7e8-4773-8c3f-5527f4d6b162 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:46.903690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 748/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:45:46.908813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c517-5300-40c4-bc13-3de61d1172bd None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:46.909216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c517-5300-40c4-bc13-3de61d1172bd None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:46.909364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c517-5300-40c4-bc13-3de61d1172bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:46.927037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9b83c517-5300-40c4-bc13-3de61d1172bd None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:45:46.928258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9b83c517-5300-40c4-bc13-3de61d1172bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:45:46.937278 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 721/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:45:46.974723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac1525-b7e8-4773-8c3f-5527f4d6b162 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:45:46.985362 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac1525-b7e8-4773-8c3f-5527f4d6b162 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:45:46.988790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15500f41-8c0d-4853-9c15-c680f125ad4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:45:46.989413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15500f41-8c0d-4853-9c15-c680f125ad4a service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:45:46.989690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15500f41-8c0d-4853-9c15-c680f125ad4a service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:45:46.989962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15500f41-8c0d-4853-9c15-c680f125ad4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:45:46.999776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15500f41-8c0d-4853-9c15-c680f125ad4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:45:47.002254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15500f41-8c0d-4853-9c15-c680f125ad4a service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:45:47.014365 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 749/1470] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:45:56.922182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=17 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:45:57.008845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=17 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:07.881437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c623-27c0-4da3-ac18-28cc7f002458 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:07.882012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c623-27c0-4da3-ac18-28cc7f002458 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:07.882012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c623-27c0-4da3-ac18-28cc7f002458 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:07.883372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 722/1471] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:46:07.888952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c484b0e-bde5-4c11-8540-1160aaaa2b5e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:07.889420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c484b0e-bde5-4c11-8540-1160aaaa2b5e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:07.889529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c484b0e-bde5-4c11-8540-1160aaaa2b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:07.907963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-8c484b0e-bde5-4c11-8540-1160aaaa2b5e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:07.909157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-8c484b0e-bde5-4c11-8540-1160aaaa2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:07.917660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 750/1472] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:07.965507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153c97-96c0-45f5-a7f7-75f396fc27e8 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:07.965796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153c97-96c0-45f5-a7f7-75f396fc27e8 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:07.966078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153c97-96c0-45f5-a7f7-75f396fc27e8 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:07.967491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 723/1473] 10.222.0.78 () {54 vars in 962 bytes} [Fri Jun 17 08:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:46:07.972484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3455b-11cd-46f6-a5fe-7c0b2fff4d69 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:07.972775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3455b-11cd-46f6-a5fe-7c0b2fff4d69 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:07.973057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3455b-11cd-46f6-a5fe-7c0b2fff4d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:07.991611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-7af3455b-11cd-46f6-a5fe-7c0b2fff4d69 None None] MFA Rules not processed for user `d039be6500e74ae3a6f30821c5c19a99`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:07.992804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7af3455b-11cd-46f6-a5fe-7c0b2fff4d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:07.999305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 751/1474] 10.222.0.78 () {58 vars in 1059 bytes} [Fri Jun 17 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:08.006686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe153c97-96c0-45f5-a7f7-75f396fc27e8 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:08.017425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe153c97-96c0-45f5-a7f7-75f396fc27e8 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:08.020981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922190-8ed0-4a89-8daf-7a8aee1380b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd039be6500e74ae3a6f30821c5c19a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:08.022115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922190-8ed0-4a89-8daf-7a8aee1380b8 service glance] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:08.022399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922190-8ed0-4a89-8daf-7a8aee1380b8 service glance] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:08.022681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922190-8ed0-4a89-8daf-7a8aee1380b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:08.032462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6922190-8ed0-4a89-8daf-7a8aee1380b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:08.033898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6922190-8ed0-4a89-8daf-7a8aee1380b8 service glance] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:08.044601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 724/1475] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:10.284434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167fe5-83ca-498c-9226-1aac0530ccea None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:10.285041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167fe5-83ca-498c-9226-1aac0530ccea None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:10.285041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167fe5-83ca-498c-9226-1aac0530ccea None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:10.286350 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 752/1476] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:46:10.291747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32725d8e-710f-4f8a-b319-526b177a1be4 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:10.292235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32725d8e-710f-4f8a-b319-526b177a1be4 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:10.292353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32725d8e-710f-4f8a-b319-526b177a1be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:10.310799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-32725d8e-710f-4f8a-b319-526b177a1be4 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:10.311932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-32725d8e-710f-4f8a-b319-526b177a1be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:10.320903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 725/1477] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:10.343805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb167fe5-83ca-498c-9226-1aac0530ccea None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:10.356500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb167fe5-83ca-498c-9226-1aac0530ccea None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:10.360846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05ad39-ec56-482a-85e1-4f758ed99d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:10.361482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05ad39-ec56-482a-85e1-4f758ed99d5e admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:10.361760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05ad39-ec56-482a-85e1-4f758ed99d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:10.362029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05ad39-ec56-482a-85e1-4f758ed99d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:10.362749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05ad39-ec56-482a-85e1-4f758ed99d5e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:10.364565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: WARNING py.warnings [None req-3d05ad39-ec56-482a-85e1-4f758ed99d5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:46:10.364565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: warnings.warn(msg) Jun 17 08:46:10.364565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: Jun 17 08:46:10.366430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05ad39-ec56-482a-85e1-4f758ed99d5e admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:10.385574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 753/1478] 10.222.0.78 () {56 vars in 1108 bytes} [Fri Jun 17 08:46:10 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:46:12.563682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f77de3-4cd0-4498-b441-98cc651af8da None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:12.564492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f77de3-4cd0-4498-b441-98cc651af8da None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:12.564492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f77de3-4cd0-4498-b441-98cc651af8da None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:12.565871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 726/1479] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:46:12.571679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36279a0-05d0-407c-8e40-a4b617de0073 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:12.572151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36279a0-05d0-407c-8e40-a4b617de0073 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:12.572259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36279a0-05d0-407c-8e40-a4b617de0073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:12.590089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f36279a0-05d0-407c-8e40-a4b617de0073 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:12.591290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f36279a0-05d0-407c-8e40-a4b617de0073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:12.599090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 754/1480] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:12.642603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f77de3-4cd0-4498-b441-98cc651af8da None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:12.661321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f77de3-4cd0-4498-b441-98cc651af8da None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:12.663480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc958b-ba64-4c11-ab82-46fc88b053ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:12.664318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc958b-ba64-4c11-ab82-46fc88b053ee service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:12.664626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc958b-ba64-4c11-ab82-46fc88b053ee service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:12.664900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc958b-ba64-4c11-ab82-46fc88b053ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:12.673975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc958b-ba64-4c11-ab82-46fc88b053ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:12.675588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc958b-ba64-4c11-ab82-46fc88b053ee service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:12.690577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 727/1481] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:15.039594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55198ae-bc37-4c89-be68-0ca363023b09 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:15.040140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55198ae-bc37-4c89-be68-0ca363023b09 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:15.040140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55198ae-bc37-4c89-be68-0ca363023b09 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:15.041491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 755/1482] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:46:15.046640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0fbb5-98f7-49cd-a9c5-c086091d1f47 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:15.047092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0fbb5-98f7-49cd-a9c5-c086091d1f47 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:15.047250 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0fbb5-98f7-49cd-a9c5-c086091d1f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:15.065783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-fba0fbb5-98f7-49cd-a9c5-c086091d1f47 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:15.066970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-fba0fbb5-98f7-49cd-a9c5-c086091d1f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:15.075444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 728/1483] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:15.111567 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55198ae-bc37-4c89-be68-0ca363023b09 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:15.122182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55198ae-bc37-4c89-be68-0ca363023b09 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:15.125702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056464a5-7a21-433e-8917-e5daea460d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:15.126332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056464a5-7a21-433e-8917-e5daea460d64 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:15.126611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056464a5-7a21-433e-8917-e5daea460d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:15.126885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056464a5-7a21-433e-8917-e5daea460d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:15.136214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056464a5-7a21-433e-8917-e5daea460d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:15.137642 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056464a5-7a21-433e-8917-e5daea460d64 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:15.147530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 756/1484] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:17.339952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31f88a-acae-415d-99b1-9db7d38aa62d None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:17.340501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31f88a-acae-415d-99b1-9db7d38aa62d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:17.340501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31f88a-acae-415d-99b1-9db7d38aa62d None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:17.341928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 729/1485] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:46:17.347181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1afa3f-49aa-477a-9b8c-f045871970fc None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:17.347644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1afa3f-49aa-477a-9b8c-f045871970fc None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:17.347754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1afa3f-49aa-477a-9b8c-f045871970fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:17.366322 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3f1afa3f-49aa-477a-9b8c-f045871970fc None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:17.367527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3f1afa3f-49aa-477a-9b8c-f045871970fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:17.375141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 757/1486] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:17.414062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31f88a-acae-415d-99b1-9db7d38aa62d None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:17.425180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31f88a-acae-415d-99b1-9db7d38aa62d None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:17.429474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a264-0a60-4bcc-9f2a-68395b0a0b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:17.430126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a264-0a60-4bcc-9f2a-68395b0a0b09 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:17.430409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a264-0a60-4bcc-9f2a-68395b0a0b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:17.430688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a264-0a60-4bcc-9f2a-68395b0a0b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:17.441002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03a264-0a60-4bcc-9f2a-68395b0a0b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:17.442366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03a264-0a60-4bcc-9f2a-68395b0a0b09 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:17.453155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 730/1487] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:19.745473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24c912-20d4-4884-999a-db28a55d6096 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:19.746031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24c912-20d4-4884-999a-db28a55d6096 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:19.746031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24c912-20d4-4884-999a-db28a55d6096 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:19.747408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 758/1488] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:46:19.752504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f689301-be18-462f-82be-14aec003a65a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:19.752942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f689301-be18-462f-82be-14aec003a65a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:19.753067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f689301-be18-462f-82be-14aec003a65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:19.772019 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-3f689301-be18-462f-82be-14aec003a65a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:19.773398 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3f689301-be18-462f-82be-14aec003a65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:19.781184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 731/1489] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:19.821443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24c912-20d4-4884-999a-db28a55d6096 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:19.832228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24c912-20d4-4884-999a-db28a55d6096 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:19.836534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b53ce3-6315-4902-a308-a55ffc8ee745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:19.837170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53ce3-6315-4902-a308-a55ffc8ee745 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:19.837451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53ce3-6315-4902-a308-a55ffc8ee745 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:19.837726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53ce3-6315-4902-a308-a55ffc8ee745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:19.846522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b53ce3-6315-4902-a308-a55ffc8ee745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:19.847987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b53ce3-6315-4902-a308-a55ffc8ee745 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:19.858308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 759/1490] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:22.369585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ec06-e563-4261-8fc0-fcde5104e09c None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:22.370148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ec06-e563-4261-8fc0-fcde5104e09c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:22.370148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789ec06-e563-4261-8fc0-fcde5104e09c None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:22.371539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 732/1491] 10.222.0.78 () {54 vars in 926 bytes} [Fri Jun 17 08:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:46:22.376776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166b6f9-8374-452f-bde8-74c7308537da None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:22.377197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166b6f9-8374-452f-bde8-74c7308537da None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:22.377350 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166b6f9-8374-452f-bde8-74c7308537da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:22.395465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-0166b6f9-8374-452f-bde8-74c7308537da None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:46:22.397414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0166b6f9-8374-452f-bde8-74c7308537da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:46:22.405240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 760/1492] 10.222.0.78 () {58 vars in 1023 bytes} [Fri Jun 17 08:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:46:22.444097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789ec06-e563-4261-8fc0-fcde5104e09c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:46:22.455041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789ec06-e563-4261-8fc0-fcde5104e09c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:46:22.459519 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639df00a-a645-4e71-b14f-b16b6c0632c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:46:22.460174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639df00a-a645-4e71-b14f-b16b6c0632c9 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:46:22.460482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639df00a-a645-4e71-b14f-b16b6c0632c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:46:22.460762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639df00a-a645-4e71-b14f-b16b6c0632c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:46:22.470150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639df00a-a645-4e71-b14f-b16b6c0632c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:46:22.471639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639df00a-a645-4e71-b14f-b16b6c0632c9 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:46:22.482079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 733/1493] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:46:32.390310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=33 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:46:32.477254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=33 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:56.286322 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaf645-7b3c-4650-9bf4-75c99f0e12ed None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:56.286945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaf645-7b3c-4650-9bf4-75c99f0e12ed None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:56.286945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaf645-7b3c-4650-9bf4-75c99f0e12ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:56.305348 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-e8aaf645-7b3c-4650-9bf4-75c99f0e12ed None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:47:56.311721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e8aaf645-7b3c-4650-9bf4-75c99f0e12ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:56.314658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 761/1494] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:47:56.324122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc07c-8d68-4fc3-860b-b24597060ee9 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:56.324645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc07c-8d68-4fc3-860b-b24597060ee9 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:56.324752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc07c-8d68-4fc3-860b-b24597060ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:56.342626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8d9cc07c-8d68-4fc3-860b-b24597060ee9 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:47:56.343877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8d9cc07c-8d68-4fc3-860b-b24597060ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:56.352231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 734/1495] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:47:56.357005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaf645-7b3c-4650-9bf4-75c99f0e12ed None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:56.367294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaf645-7b3c-4650-9bf4-75c99f0e12ed None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:56.371835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf071-390b-4fff-a5b0-bb1b49e3564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:56.372484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf071-390b-4fff-a5b0-bb1b49e3564a admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:56.372764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf071-390b-4fff-a5b0-bb1b49e3564a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:56.373037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf071-390b-4fff-a5b0-bb1b49e3564a admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:56.373755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bf071-390b-4fff-a5b0-bb1b49e3564a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:47:56.374056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bf071-390b-4fff-a5b0-bb1b49e3564a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:56.375063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: WARNING py.warnings [None req-566bf071-390b-4fff-a5b0-bb1b49e3564a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:47:56.375063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: warnings.warn(msg) Jun 17 08:47:56.375063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: Jun 17 08:47:56.376155 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bf071-390b-4fff-a5b0-bb1b49e3564a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:56.387701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 762/1496] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:47:56.395807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc07c-8d68-4fc3-860b-b24597060ee9 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:56.405288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc07c-8d68-4fc3-860b-b24597060ee9 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:56.409913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d2df-52b2-4efd-8a36-3b4ebcece003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:56.411075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d2df-52b2-4efd-8a36-3b4ebcece003 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:56.411488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d2df-52b2-4efd-8a36-3b4ebcece003 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:56.411774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d2df-52b2-4efd-8a36-3b4ebcece003 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:56.412461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870d2df-52b2-4efd-8a36-3b4ebcece003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:56.414237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: WARNING py.warnings [None req-a870d2df-52b2-4efd-8a36-3b4ebcece003 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:47:56.414237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: warnings.warn(msg) Jun 17 08:47:56.414237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: Jun 17 08:47:56.415466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870d2df-52b2-4efd-8a36-3b4ebcece003 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:56.520289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 735/1497] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:47:56 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:47:56.524894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf071-390b-4fff-a5b0-bb1b49e3564a admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:56.534795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf071-390b-4fff-a5b0-bb1b49e3564a admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:56.590919 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5b7e-1ede-4952-8e9e-391fdf0f9d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:56.591534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5b7e-1ede-4952-8e9e-391fdf0f9d57 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:56.591816 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5b7e-1ede-4952-8e9e-391fdf0f9d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:56.592092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5b7e-1ede-4952-8e9e-391fdf0f9d57 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:56.592804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d5b7e-1ede-4952-8e9e-391fdf0f9d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:56.593797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: WARNING py.warnings [None req-ca5d5b7e-1ede-4952-8e9e-391fdf0f9d57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:47:56.593797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: warnings.warn(msg) Jun 17 08:47:56.593797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: Jun 17 08:47:56.594995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d5b7e-1ede-4952-8e9e-391fdf0f9d57 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:56.693647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 763/1498] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:47:56 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:47:56.698037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d2df-52b2-4efd-8a36-3b4ebcece003 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:56.709148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d2df-52b2-4efd-8a36-3b4ebcece003 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:56.713680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990bc62-90b3-4685-b17f-c12a37fb319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:56.714352 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990bc62-90b3-4685-b17f-c12a37fb319b admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:56.714636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990bc62-90b3-4685-b17f-c12a37fb319b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:56.714932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990bc62-90b3-4685-b17f-c12a37fb319b admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:56.715681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990bc62-90b3-4685-b17f-c12a37fb319b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:56.716704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: WARNING py.warnings [None req-a990bc62-90b3-4685-b17f-c12a37fb319b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:47:56.716704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: warnings.warn(msg) Jun 17 08:47:56.716704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: Jun 17 08:47:56.717609 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990bc62-90b3-4685-b17f-c12a37fb319b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:56.731415 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 736/1499] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:47:56.735484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5b7e-1ede-4952-8e9e-391fdf0f9d57 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:56.745774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5b7e-1ede-4952-8e9e-391fdf0f9d57 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:56.750306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41869cbf-f32e-4e06-967f-8bae0f3c801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:56.750996 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41869cbf-f32e-4e06-967f-8bae0f3c801a admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:56.751280 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41869cbf-f32e-4e06-967f-8bae0f3c801a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:56.751589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41869cbf-f32e-4e06-967f-8bae0f3c801a admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:56.752315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41869cbf-f32e-4e06-967f-8bae0f3c801a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:56.753325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: WARNING py.warnings [None req-41869cbf-f32e-4e06-967f-8bae0f3c801a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:47:56.753325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: warnings.warn(msg) Jun 17 08:47:56.753325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: Jun 17 08:47:56.754205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41869cbf-f32e-4e06-967f-8bae0f3c801a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:56.767384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 764/1500] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:47:56.772123 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990bc62-90b3-4685-b17f-c12a37fb319b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:56.782162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990bc62-90b3-4685-b17f-c12a37fb319b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:56.787332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79811d-74d5-4b40-9aee-52981f161262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:56.788242 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79811d-74d5-4b40-9aee-52981f161262 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:56.788524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79811d-74d5-4b40-9aee-52981f161262 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:56.788798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79811d-74d5-4b40-9aee-52981f161262 admin admin] PATH_INFO: `/v3/projects/70c4bf8639fc41baa526bfc435767535/users/c6bbecb369644fa48509f0a74224f2fe/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:56.803869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79811d-74d5-4b40-9aee-52981f161262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c4bf8639fc41baa526bfc435767535, user_id=c6bbecb369644fa48509f0a74224f2fe, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:56.804901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: WARNING py.warnings [None req-ea79811d-74d5-4b40-9aee-52981f161262 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:47:56.804901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: warnings.warn(msg) Jun 17 08:47:56.804901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: Jun 17 08:47:56.806815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79811d-74d5-4b40-9aee-52981f161262 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:56.882023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 737/1501] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:47:56 2022] PUT /identity/v3/projects/70c4bf8639fc41baa526bfc435767535/users/c6bbecb369644fa48509f0a74224f2fe/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:47:56.893331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747518-e5ab-44ed-8376-9bd66ab88750 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:56.893650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747518-e5ab-44ed-8376-9bd66ab88750 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:56.893960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747518-e5ab-44ed-8376-9bd66ab88750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:56.920881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f4747518-e5ab-44ed-8376-9bd66ab88750 None None] MFA Rules not processed for user `c6bbecb369644fa48509f0a74224f2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:47:56.922089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f4747518-e5ab-44ed-8376-9bd66ab88750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:56.985874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 765/1502] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:47:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:47:56.999401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf978b-d4b8-41b9-b26d-ad32a36497c4 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:56.999695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf978b-d4b8-41b9-b26d-ad32a36497c4 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:56.999976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf978b-d4b8-41b9-b26d-ad32a36497c4 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:57.001376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 738/1503] 10.222.0.78 () {54 vars in 963 bytes} [Fri Jun 17 08:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:47:57.006777 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c543b4c-738a-4d1a-b247-be72198d3db3 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:57.007093 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c543b4c-738a-4d1a-b247-be72198d3db3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:57.007403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c543b4c-738a-4d1a-b247-be72198d3db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:57.027805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1c543b4c-738a-4d1a-b247-be72198d3db3 None None] MFA Rules not processed for user `bd7feb1014c44c5a9b3832bad417b47c`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:47:57.029003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1c543b4c-738a-4d1a-b247-be72198d3db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:57.072761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:57.080399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 766/1504] 10.222.0.78 () {58 vars in 1060 bytes} [Fri Jun 17 08:47:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:47:57.088286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf978b-d4b8-41b9-b26d-ad32a36497c4 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:57.099543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf978b-d4b8-41b9-b26d-ad32a36497c4 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:57.103047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe43d4-9271-4b1f-bf13-4ab75ad1994f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:57.103706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe43d4-9271-4b1f-bf13-4ab75ad1994f service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:57.103987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe43d4-9271-4b1f-bf13-4ab75ad1994f service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:57.104261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe43d4-9271-4b1f-bf13-4ab75ad1994f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:57.112666 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe43d4-9271-4b1f-bf13-4ab75ad1994f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:57.122521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe43d4-9271-4b1f-bf13-4ab75ad1994f service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:57.123953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 739/1505] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:47:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:47:57.166386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474b5e4-76d0-4947-b8b6-13783afbfb14 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:57.166680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474b5e4-76d0-4947-b8b6-13783afbfb14 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:57.166962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474b5e4-76d0-4947-b8b6-13783afbfb14 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:57.168261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 767/1506] 10.222.0.78 () {52 vars in 829 bytes} [Fri Jun 17 08:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:47:57.171870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe43d4-9271-4b1f-bf13-4ab75ad1994f service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:57.234394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe43d4-9271-4b1f-bf13-4ab75ad1994f service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:57.239007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:57.239912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:57.240196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:57.240469 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] PATH_INFO: `/v3/users/c6bbecb369644fa48509f0a74224f2fe` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:57.241651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bbecb369644fa48509f0a74224f2fe)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:57.242651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: WARNING py.warnings [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:47:57.242651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: warnings.warn(msg) Jun 17 08:47:57.242651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: Jun 17 08:47:57.243883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:57.439867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bbecb369644fa48509f0a74224f2fe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:47:57.453366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bbecb369644fa48509f0a74224f2fe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:47:57.506718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bbecb369644fa48509f0a74224f2fe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:47:57.507381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bbecb369644fa48509f0a74224f2fe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:47:57.508107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bbecb369644fa48509f0a74224f2fe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:47:57.525315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:47:57.533666 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 740/1507] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:47:57 2022] DELETE /identity/v3/users/c6bbecb369644fa48509f0a74224f2fe => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:47:57.538231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be794010-a282-44ac-8dea-0f81b8858c3e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:57.540878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be794010-a282-44ac-8dea-0f81b8858c3e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:57.540878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be794010-a282-44ac-8dea-0f81b8858c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:57.557186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-be794010-a282-44ac-8dea-0f81b8858c3e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:47:57.558386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-be794010-a282-44ac-8dea-0f81b8858c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:57.619088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 768/1508] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:47:57.629660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:57.631148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:57.689665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3d19a-b147-4f5e-a8fc-e3aad4ed4551 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:57.693527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01895ca1-b36d-4ec9-8eaa-61e87ef87c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:57.694117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895ca1-b36d-4ec9-8eaa-61e87ef87c4c service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:57.694396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895ca1-b36d-4ec9-8eaa-61e87ef87c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:57.694688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895ca1-b36d-4ec9-8eaa-61e87ef87c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:57.703927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01895ca1-b36d-4ec9-8eaa-61e87ef87c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:57.705369 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01895ca1-b36d-4ec9-8eaa-61e87ef87c4c service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:57.715249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 741/1509] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:47:58.240852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be794010-a282-44ac-8dea-0f81b8858c3e None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:47:58.242672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-be794010-a282-44ac-8dea-0f81b8858c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:47:58.256498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be794010-a282-44ac-8dea-0f81b8858c3e None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:47:58.261180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:47:58.262073 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:47:58.262351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:47:58.262628 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] PATH_INFO: `/v3/projects/70c4bf8639fc41baa526bfc435767535` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:47:58.263839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c4bf8639fc41baa526bfc435767535)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:47:58.264927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: WARNING py.warnings [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:47:58.264927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: warnings.warn(msg) Jun 17 08:47:58.264927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: Jun 17 08:47:58.266089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:47:58.385857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c4bf8639fc41baa526bfc435767535', 'request_id': 'req-baf67631-f7ee-4cdf-8906-dcdc528a04ea'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:47:58.399684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c4bf8639fc41baa526bfc435767535', 'request_id': 'req-baf67631-f7ee-4cdf-8906-dcdc528a04ea'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:47:58.406010 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c4bf8639fc41baa526bfc435767535', 'request_id': 'req-baf67631-f7ee-4cdf-8906-dcdc528a04ea'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:47:58.503695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] The token cache is being invalidate because project 70c4bf8639fc41baa526bfc435767535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:47:58.508184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:47:58.508184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-baf67631-f7ee-4cdf-8906-dcdc528a04ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:47:58.508184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 769/1510] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:47:58 2022] DELETE /identity/v3/projects/70c4bf8639fc41baa526bfc435767535 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:48:07.710883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:48:08.500283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:49:41.525297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe2ca0-99f5-4be3-8ac3-5a88d6d37256 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:41.525920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe2ca0-99f5-4be3-8ac3-5a88d6d37256 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:41.525920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe2ca0-99f5-4be3-8ac3-5a88d6d37256 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:41.527261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 742/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:49:41.532293 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892bb79-c280-4a96-a383-4ae5ed20cf42 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:41.532761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892bb79-c280-4a96-a383-4ae5ed20cf42 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:41.532860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892bb79-c280-4a96-a383-4ae5ed20cf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:41.551538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-d892bb79-c280-4a96-a383-4ae5ed20cf42 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:49:41.552775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d892bb79-c280-4a96-a383-4ae5ed20cf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:49:41.610619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 770/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:49:41.781406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe2ca0-99f5-4be3-8ac3-5a88d6d37256 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:49:41.783132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9ebe2ca0-99f5-4be3-8ac3-5a88d6d37256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:49:41.858696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe2ca0-99f5-4be3-8ac3-5a88d6d37256 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:49:41.864619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39320db3-a849-4f80-8dd7-bb22cc766d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:49:41.865264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39320db3-a849-4f80-8dd7-bb22cc766d4c service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:41.865553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39320db3-a849-4f80-8dd7-bb22cc766d4c service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:41.865836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39320db3-a849-4f80-8dd7-bb22cc766d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:41.873960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39320db3-a849-4f80-8dd7-bb22cc766d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:49:41.875633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39320db3-a849-4f80-8dd7-bb22cc766d4c service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:49:41.885833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 743/1513] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:49:42.776220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473e4f2-fee0-4f09-a27e-b207abe340b2 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:42.776778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473e4f2-fee0-4f09-a27e-b207abe340b2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:42.776778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473e4f2-fee0-4f09-a27e-b207abe340b2 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:42.778157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 771/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:49:42.783280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee0ff0-7914-451a-b6a6-fef590ee985c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:42.783751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee0ff0-7914-451a-b6a6-fef590ee985c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:42.784061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee0ff0-7914-451a-b6a6-fef590ee985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:42.804452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d6ee0ff0-7914-451a-b6a6-fef590ee985c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:49:42.805672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d6ee0ff0-7914-451a-b6a6-fef590ee985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:49:42.813808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 744/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:49:42.967997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473e4f2-fee0-4f09-a27e-b207abe340b2 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:49:42.982646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473e4f2-fee0-4f09-a27e-b207abe340b2 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:49:42.989073 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599a0c9-90f8-4722-b422-7b1448f03662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:49:42.989717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599a0c9-90f8-4722-b422-7b1448f03662 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:42.990008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599a0c9-90f8-4722-b422-7b1448f03662 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:42.990290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599a0c9-90f8-4722-b422-7b1448f03662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:42.998586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599a0c9-90f8-4722-b422-7b1448f03662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:49:43.000375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599a0c9-90f8-4722-b422-7b1448f03662 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:49:43.011086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 772/1516] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:49:43.323101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee1451-6bfe-424e-8fa4-b2f3b6d75578 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:43.323319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee1451-6bfe-424e-8fa4-b2f3b6d75578 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:43.323638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee1451-6bfe-424e-8fa4-b2f3b6d75578 None None] PATH_INFO: `/v3` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:43.324986 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 745/1517] 10.222.0.83 () {54 vars in 925 bytes} [Fri Jun 17 08:49:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:49:43.331172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe607d-1640-4fd1-90b8-5e981b8575d2 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:43.331482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe607d-1640-4fd1-90b8-5e981b8575d2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:43.331763 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe607d-1640-4fd1-90b8-5e981b8575d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:43.350116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1abe607d-1640-4fd1-90b8-5e981b8575d2 None None] MFA Rules not processed for user `f79f43c31f5346d5b1e6ae6ff8c511a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:49:43.351298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1abe607d-1640-4fd1-90b8-5e981b8575d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:49:43.411947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 773/1518] 10.222.0.83 () {58 vars in 1015 bytes} [Fri Jun 17 08:49:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:49:47.355432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc3d53-17b3-4f07-a78a-773c40705911 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:47.355945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc3d53-17b3-4f07-a78a-773c40705911 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:47.355945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc3d53-17b3-4f07-a78a-773c40705911 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:47.357250 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 746/1519] 10.222.0.78 () {54 vars in 960 bytes} [Fri Jun 17 08:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:49:47.362234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74386ad-6ea2-47b1-a2ff-79f441c1ac8a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:47.362650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74386ad-6ea2-47b1-a2ff-79f441c1ac8a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:47.362801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74386ad-6ea2-47b1-a2ff-79f441c1ac8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:47.383707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-e74386ad-6ea2-47b1-a2ff-79f441c1ac8a None None] MFA Rules not processed for user `f79f43c31f5346d5b1e6ae6ff8c511a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:49:47.384905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e74386ad-6ea2-47b1-a2ff-79f441c1ac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:49:47.393360 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 774/1520] 10.222.0.78 () {58 vars in 1057 bytes} [Fri Jun 17 08:49:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:49:47.403275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc3d53-17b3-4f07-a78a-773c40705911 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:49:47.417617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc3d53-17b3-4f07-a78a-773c40705911 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:49:47.422524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af7a2d-62d7-49c4-9d7c-2715a0dd3240 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:49:47.425254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7a2d-62d7-49c4-9d7c-2715a0dd3240 service placement] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:47.425254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7a2d-62d7-49c4-9d7c-2715a0dd3240 service placement] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:47.425254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7a2d-62d7-49c4-9d7c-2715a0dd3240 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:47.432463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af7a2d-62d7-49c4-9d7c-2715a0dd3240 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:49:47.434058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af7a2d-62d7-49c4-9d7c-2715a0dd3240 service placement] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:49:47.444374 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 747/1521] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:49:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:49:54.374509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbe62a-fc40-4600-ba02-c989d6faf3d5 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:54.375089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbe62a-fc40-4600-ba02-c989d6faf3d5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:54.375526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbe62a-fc40-4600-ba02-c989d6faf3d5 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:54.377391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 775/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:49:54.383953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4f8ca-6332-41da-beca-447b449808da None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:54.384473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4f8ca-6332-41da-beca-447b449808da None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:54.384568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4f8ca-6332-41da-beca-447b449808da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:54.532603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-aac4f8ca-6332-41da-beca-447b449808da None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:49:54.533842 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-aac4f8ca-6332-41da-beca-447b449808da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:49:54.542804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 748/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:49:54.704771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbe62a-fc40-4600-ba02-c989d6faf3d5 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:49:54.720834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbe62a-fc40-4600-ba02-c989d6faf3d5 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:49:54.726962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bc958-1b66-4d8a-85f1-1f29898c2818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:49:54.727737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bc958-1b66-4d8a-85f1-1f29898c2818 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:54.728022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bc958-1b66-4d8a-85f1-1f29898c2818 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:54.728296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bc958-1b66-4d8a-85f1-1f29898c2818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:54.738429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bc958-1b66-4d8a-85f1-1f29898c2818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:49:54.741164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bc958-1b66-4d8a-85f1-1f29898c2818 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:49:54.754617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 776/1524] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:49:55.749547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95627e-669f-4a35-b507-4d9cd42c143f None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:55.750125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95627e-669f-4a35-b507-4d9cd42c143f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:55.750125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95627e-669f-4a35-b507-4d9cd42c143f None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:55.751506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 749/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 17 08:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:49:55.756500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e72c6-679e-4efa-bfd5-0071581509c1 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:55.756981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e72c6-679e-4efa-bfd5-0071581509c1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:55.757090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e72c6-679e-4efa-bfd5-0071581509c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:55.775598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-759e72c6-679e-4efa-bfd5-0071581509c1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:49:55.776803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-759e72c6-679e-4efa-bfd5-0071581509c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:49:55.784587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 777/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 17 08:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:49:55.939742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95627e-669f-4a35-b507-4d9cd42c143f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:49:55.955157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95627e-669f-4a35-b507-4d9cd42c143f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:49:55.960706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7775ba-52f0-4f9e-8d43-09209a92915a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:49:55.961349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7775ba-52f0-4f9e-8d43-09209a92915a service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:55.961634 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7775ba-52f0-4f9e-8d43-09209a92915a service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:55.961905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7775ba-52f0-4f9e-8d43-09209a92915a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:55.970500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7775ba-52f0-4f9e-8d43-09209a92915a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:49:55.972110 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7775ba-52f0-4f9e-8d43-09209a92915a service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:49:55.982700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 750/1527] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:49:59.982763 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e6bbb-ecc2-4928-b5f4-b9165c96eb58 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:59.983377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e6bbb-ecc2-4928-b5f4-b9165c96eb58 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:59.983377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e6bbb-ecc2-4928-b5f4-b9165c96eb58 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:49:59.984860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 778/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:49:59.990897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8aca41-e1c7-41f7-a615-3ac562b92437 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:49:59.991318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8aca41-e1c7-41f7-a615-3ac562b92437 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:49:59.991484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8aca41-e1c7-41f7-a615-3ac562b92437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:00.009761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2b8aca41-e1c7-41f7-a615-3ac562b92437 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:50:00.010954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2b8aca41-e1c7-41f7-a615-3ac562b92437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:00.018943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 751/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:50:00.056521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e6bbb-ecc2-4928-b5f4-b9165c96eb58 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:00.058315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c42e6bbb-ecc2-4928-b5f4-b9165c96eb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:00.122981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e6bbb-ecc2-4928-b5f4-b9165c96eb58 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:00.126763 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fc812-662e-4541-b918-440426ecfc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:00.127454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fc812-662e-4541-b918-440426ecfc4e service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:00.127735 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fc812-662e-4541-b918-440426ecfc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:00.128009 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fc812-662e-4541-b918-440426ecfc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:00.138416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fc812-662e-4541-b918-440426ecfc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:00.139986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fc812-662e-4541-b918-440426ecfc4e service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:00.146355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:00.150971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 779/1530] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:50:02.322647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973a30-48cd-45f1-83c2-d4c49f4418aa None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:02.323320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973a30-48cd-45f1-83c2-d4c49f4418aa None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:02.323320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973a30-48cd-45f1-83c2-d4c49f4418aa None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:02.324591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 752/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:50:02.330494 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803752b-e0f9-44c9-a449-0b4b513874a6 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:02.334859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803752b-e0f9-44c9-a449-0b4b513874a6 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:02.334859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803752b-e0f9-44c9-a449-0b4b513874a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:02.350415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-4803752b-e0f9-44c9-a449-0b4b513874a6 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:50:02.351659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4803752b-e0f9-44c9-a449-0b4b513874a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:02.359739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 780/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:50:02.397166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb973a30-48cd-45f1-83c2-d4c49f4418aa None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:02.408338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb973a30-48cd-45f1-83c2-d4c49f4418aa None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:02.412394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00cad1-806a-413b-ad33-11b91d7647b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:02.413059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00cad1-806a-413b-ad33-11b91d7647b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:02.413344 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00cad1-806a-413b-ad33-11b91d7647b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:02.413645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00cad1-806a-413b-ad33-11b91d7647b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:02.423765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00cad1-806a-413b-ad33-11b91d7647b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:02.425221 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00cad1-806a-413b-ad33-11b91d7647b6 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:02.437235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 753/1533] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:50:06.002937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015776-5c20-4887-b3bb-594b1ff44cbd None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:06.003549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015776-5c20-4887-b3bb-594b1ff44cbd None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:06.003549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015776-5c20-4887-b3bb-594b1ff44cbd None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:06.004932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 781/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:50:06.010235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ed7ce-00fc-4cfe-9ef7-cd482f447f4a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:06.010692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ed7ce-00fc-4cfe-9ef7-cd482f447f4a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:06.010797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ed7ce-00fc-4cfe-9ef7-cd482f447f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:06.028518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9c9ed7ce-00fc-4cfe-9ef7-cd482f447f4a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:50:06.029704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9c9ed7ce-00fc-4cfe-9ef7-cd482f447f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:06.037892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 754/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:50:06.304145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015776-5c20-4887-b3bb-594b1ff44cbd None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:06.305968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-19015776-5c20-4887-b3bb-594b1ff44cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:06.366586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015776-5c20-4887-b3bb-594b1ff44cbd None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:06.370707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbfe20-22b8-4f86-b5a7-4f8bd32cfc21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:06.371402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfe20-22b8-4f86-b5a7-4f8bd32cfc21 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:06.371689 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfe20-22b8-4f86-b5a7-4f8bd32cfc21 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:06.371966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfe20-22b8-4f86-b5a7-4f8bd32cfc21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:06.382018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbfe20-22b8-4f86-b5a7-4f8bd32cfc21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:06.386079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbfe20-22b8-4f86-b5a7-4f8bd32cfc21 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:06.394197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 782/1536] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:50:08.582699 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555b1e-2906-47cd-97fc-0b7a283120f6 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:08.583537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555b1e-2906-47cd-97fc-0b7a283120f6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:08.583537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555b1e-2906-47cd-97fc-0b7a283120f6 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:08.584870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 755/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 17 08:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:50:08.590087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18aec1-ff4a-4f4f-9239-5d98c621d629 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:08.590506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18aec1-ff4a-4f4f-9239-5d98c621d629 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:08.590626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18aec1-ff4a-4f4f-9239-5d98c621d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:08.608939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-bf18aec1-ff4a-4f4f-9239-5d98c621d629 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:50:08.610143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-bf18aec1-ff4a-4f4f-9239-5d98c621d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:08.618535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 783/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 17 08:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:50:08.884234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63555b1e-2906-47cd-97fc-0b7a283120f6 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:50:08.885912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-63555b1e-2906-47cd-97fc-0b7a283120f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:50:08.893426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=65 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:08.899471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63555b1e-2906-47cd-97fc-0b7a283120f6 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:50:08.902952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749f45a-a6ab-4c7d-b4f0-078a8e9fcd69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:50:08.903626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749f45a-a6ab-4c7d-b4f0-078a8e9fcd69 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:50:08.903906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749f45a-a6ab-4c7d-b4f0-078a8e9fcd69 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:50:08.904181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749f45a-a6ab-4c7d-b4f0-078a8e9fcd69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:50:08.914018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749f45a-a6ab-4c7d-b4f0-078a8e9fcd69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:50:08.915476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749f45a-a6ab-4c7d-b4f0-078a8e9fcd69 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:50:08.924819 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 756/1539] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:50:18.603616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=32 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:50:18.936961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:38.776795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff19ba-c11b-4f4e-ac32-06f515e03493 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:38.778508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff19ba-c11b-4f4e-ac32-06f515e03493 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:38.779082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff19ba-c11b-4f4e-ac32-06f515e03493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:38.811932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-59ff19ba-c11b-4f4e-ac32-06f515e03493 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:38.814792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-59ff19ba-c11b-4f4e-ac32-06f515e03493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:38.835215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 784/1540] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:51:38.846155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63b821-10da-466e-8cbb-ab90e38c7356 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:38.848268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63b821-10da-466e-8cbb-ab90e38c7356 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:38.849533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63b821-10da-466e-8cbb-ab90e38c7356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:38.876879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8e63b821-10da-466e-8cbb-ab90e38c7356 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:38.879228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767deda4-50f3-4f4c-8414-e0aabd283617 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:38.879794 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767deda4-50f3-4f4c-8414-e0aabd283617 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:38.882378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767deda4-50f3-4f4c-8414-e0aabd283617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:38.890353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8e63b821-10da-466e-8cbb-ab90e38c7356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:38.910319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-767deda4-50f3-4f4c-8414-e0aabd283617 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:38.915789 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-767deda4-50f3-4f4c-8414-e0aabd283617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:38.917761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 757/1541] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:38.919879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aa12a-8765-4572-b097-0f7e453c4829 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:38.920431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aa12a-8765-4572-b097-0f7e453c4829 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:38.920939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aa12a-8765-4572-b097-0f7e453c4829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:38.934360 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 785/1542] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:51:38.935290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767deda4-50f3-4f4c-8414-e0aabd283617 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:38.950623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767deda4-50f3-4f4c-8414-e0aabd283617 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:38.958210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-aa5aa12a-8765-4572-b097-0f7e453c4829 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:38.959946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-aa5aa12a-8765-4572-b097-0f7e453c4829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:38.964922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719fac4-d808-4158-9372-b2ede449c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:38.965617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719fac4-d808-4158-9372-b2ede449c003 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:38.965900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719fac4-d808-4158-9372-b2ede449c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:38.966178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719fac4-d808-4158-9372-b2ede449c003 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:38.966917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719fac4-d808-4158-9372-b2ede449c003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:51:38.967225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719fac4-d808-4158-9372-b2ede449c003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:38.969042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719fac4-d808-4158-9372-b2ede449c003 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:38.983066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 786/1543] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:51:38.984349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 758/1544] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:38.986419 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d8440-c38f-48e4-a8d8-bac368b84732 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:38.986711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d8440-c38f-48e4-a8d8-bac368b84732 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:38.986994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d8440-c38f-48e4-a8d8-bac368b84732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:38.987568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e1cac-9315-4f76-8f02-6d65254ba1ae None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:38.988308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e1cac-9315-4f76-8f02-6d65254ba1ae None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:38.988817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e1cac-9315-4f76-8f02-6d65254ba1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.014671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-201d8440-c38f-48e4-a8d8-bac368b84732 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.015978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-201d8440-c38f-48e4-a8d8-bac368b84732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.025418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-316e1cac-9315-4f76-8f02-6d65254ba1ae None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.027141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-316e1cac-9315-4f76-8f02-6d65254ba1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.037325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 787/1545] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.039544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d8440-c38f-48e4-a8d8-bac368b84732 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.044779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 759/1546] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.051162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563320b7-efa4-4af3-8a31-7685366c83e8 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.051862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563320b7-efa4-4af3-8a31-7685366c83e8 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.053035 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563320b7-efa4-4af3-8a31-7685366c83e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.064962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d8440-c38f-48e4-a8d8-bac368b84732 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.073053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31985d-afd4-44ff-8c1e-976503cc1e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.073742 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31985d-afd4-44ff-8c1e-976503cc1e4a admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.074026 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31985d-afd4-44ff-8c1e-976503cc1e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.074430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31985d-afd4-44ff-8c1e-976503cc1e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.075126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31985d-afd4-44ff-8c1e-976503cc1e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.076639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: WARNING py.warnings [None req-ef31985d-afd4-44ff-8c1e-976503cc1e4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:51:39.076639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: warnings.warn(msg) Jun 17 08:51:39.076639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: Jun 17 08:51:39.077995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31985d-afd4-44ff-8c1e-976503cc1e4a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.080916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-563320b7-efa4-4af3-8a31-7685366c83e8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.082378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-563320b7-efa4-4af3-8a31-7685366c83e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.094374 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 760/1547] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.098151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc79c84-1ef7-4797-ae8f-ddef14d03c98 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.099091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc79c84-1ef7-4797-ae8f-ddef14d03c98 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.099903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc79c84-1ef7-4797-ae8f-ddef14d03c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.130025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-3fc79c84-1ef7-4797-ae8f-ddef14d03c98 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.132166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3fc79c84-1ef7-4797-ae8f-ddef14d03c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.141067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 761/1548] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.141880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc79c84-1ef7-4797-ae8f-ddef14d03c98 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.152871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc79c84-1ef7-4797-ae8f-ddef14d03c98 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.164054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1af05-b969-4c6c-b6f9-9f4ed03d4447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.164054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1af05-b969-4c6c-b6f9-9f4ed03d4447 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.164054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1af05-b969-4c6c-b6f9-9f4ed03d4447 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.164054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1af05-b969-4c6c-b6f9-9f4ed03d4447 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.164438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1af05-b969-4c6c-b6f9-9f4ed03d4447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:51:39.164438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1af05-b969-4c6c-b6f9-9f4ed03d4447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.164438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: WARNING py.warnings [None req-fec1af05-b969-4c6c-b6f9-9f4ed03d4447 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:51:39.164438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: warnings.warn(msg) Jun 17 08:51:39.164438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: Jun 17 08:51:39.164438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1af05-b969-4c6c-b6f9-9f4ed03d4447 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.174653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 762/1549] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:51:39.175939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb6d2-b09d-4655-a63b-fe068d2c7ecf None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.176225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb6d2-b09d-4655-a63b-fe068d2c7ecf None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.176497 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb6d2-b09d-4655-a63b-fe068d2c7ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.194965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ed2fb6d2-b09d-4655-a63b-fe068d2c7ecf None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.196223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ed2fb6d2-b09d-4655-a63b-fe068d2c7ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.204299 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 763/1550] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.205710 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be44f5-5db8-441c-bf72-aa4658308bb0 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.205998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be44f5-5db8-441c-bf72-aa4658308bb0 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.206281 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be44f5-5db8-441c-bf72-aa4658308bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.224566 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-12be44f5-5db8-441c-bf72-aa4658308bb0 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.226035 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-12be44f5-5db8-441c-bf72-aa4658308bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.234180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 764/1551] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.234948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be44f5-5db8-441c-bf72-aa4658308bb0 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.245433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be44f5-5db8-441c-bf72-aa4658308bb0 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.247133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 788/1552] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:39.248441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b27a1-24af-49d2-a4a8-665df69b34f4 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.248731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b27a1-24af-49d2-a4a8-665df69b34f4 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.249007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b27a1-24af-49d2-a4a8-665df69b34f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.266961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-847b27a1-24af-49d2-a4a8-665df69b34f4 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.268198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-847b27a1-24af-49d2-a4a8-665df69b34f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.306353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e541240-2321-41a7-83cc-f64f7434c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.306937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e541240-2321-41a7-83cc-f64f7434c924 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.307216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e541240-2321-41a7-83cc-f64f7434c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.307527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e541240-2321-41a7-83cc-f64f7434c924 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.308273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e541240-2321-41a7-83cc-f64f7434c924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:51:39.308582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e541240-2321-41a7-83cc-f64f7434c924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.310189 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e541240-2321-41a7-83cc-f64f7434c924 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.329303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 765/1553] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:51:39.329303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b7bc-b362-4e1b-b6bc-ebe6e5673219 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.329303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b7bc-b362-4e1b-b6bc-ebe6e5673219 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.329303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b7bc-b362-4e1b-b6bc-ebe6e5673219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.329885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 789/1554] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.331230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a22ab-21a4-4ac0-b83d-8bad0f601405 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.331556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a22ab-21a4-4ac0-b83d-8bad0f601405 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.331839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a22ab-21a4-4ac0-b83d-8bad0f601405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.350978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-386a22ab-21a4-4ac0-b83d-8bad0f601405 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.352501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-386a22ab-21a4-4ac0-b83d-8bad0f601405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.354998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-53b1b7bc-b362-4e1b-b6bc-ebe6e5673219 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.356241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-53b1b7bc-b362-4e1b-b6bc-ebe6e5673219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.360331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 790/1555] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.361500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a22ab-21a4-4ac0-b83d-8bad0f601405 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.364158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 766/1556] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.367527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1b7bc-b362-4e1b-b6bc-ebe6e5673219 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.375627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1b7bc-b362-4e1b-b6bc-ebe6e5673219 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.380205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09e40b-35a5-434f-ba62-02162b4fe0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.380460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a22ab-21a4-4ac0-b83d-8bad0f601405 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.381201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09e40b-35a5-434f-ba62-02162b4fe0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.381491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09e40b-35a5-434f-ba62-02162b4fe0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.381771 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09e40b-35a5-434f-ba62-02162b4fe0d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.382575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09e40b-35a5-434f-ba62-02162b4fe0d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:51:39.382889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09e40b-35a5-434f-ba62-02162b4fe0d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.384524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09e40b-35a5-434f-ba62-02162b4fe0d7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.385205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d619f7-50af-4403-a52f-c8a14a2a3566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.387641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d619f7-50af-4403-a52f-c8a14a2a3566 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.387641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d619f7-50af-4403-a52f-c8a14a2a3566 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.387641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d619f7-50af-4403-a52f-c8a14a2a3566 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.387641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d619f7-50af-4403-a52f-c8a14a2a3566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.387641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d619f7-50af-4403-a52f-c8a14a2a3566 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.478567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 767/1557] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:51:39.480425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d9ae-7640-47b4-b55f-e06a944e32aa None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.480923 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d9ae-7640-47b4-b55f-e06a944e32aa None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.481353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d9ae-7640-47b4-b55f-e06a944e32aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.503230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-15f6d9ae-7640-47b4-b55f-e06a944e32aa None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.506356 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-15f6d9ae-7640-47b4-b55f-e06a944e32aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.512578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 768/1558] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.513340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d9ae-7640-47b4-b55f-e06a944e32aa None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.523691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d9ae-7640-47b4-b55f-e06a944e32aa None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.528200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db776e01-45c6-42a4-b07c-3c6073bcd106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.528846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776e01-45c6-42a4-b07c-3c6073bcd106 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.529173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776e01-45c6-42a4-b07c-3c6073bcd106 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.529455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776e01-45c6-42a4-b07c-3c6073bcd106 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.530483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db776e01-45c6-42a4-b07c-3c6073bcd106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.531527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: WARNING py.warnings [None req-db776e01-45c6-42a4-b07c-3c6073bcd106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:51:39.531527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: warnings.warn(msg) Jun 17 08:51:39.531527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: Jun 17 08:51:39.532717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db776e01-45c6-42a4-b07c-3c6073bcd106 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.543954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 791/1559] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:39.544998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d619f7-50af-4403-a52f-c8a14a2a3566 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.607437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d619f7-50af-4403-a52f-c8a14a2a3566 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.612038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720018fa-e0d8-494d-a225-e266bae16f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.612704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720018fa-e0d8-494d-a225-e266bae16f28 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.612988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720018fa-e0d8-494d-a225-e266bae16f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.613265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720018fa-e0d8-494d-a225-e266bae16f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.613949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720018fa-e0d8-494d-a225-e266bae16f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.615992 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720018fa-e0d8-494d-a225-e266bae16f28 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.622049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 769/1560] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:39.623433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218439ae-8250-4bb4-b5e8-4cecb68b8f5a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.623722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218439ae-8250-4bb4-b5e8-4cecb68b8f5a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.623998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218439ae-8250-4bb4-b5e8-4cecb68b8f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.642141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-218439ae-8250-4bb4-b5e8-4cecb68b8f5a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.643365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-218439ae-8250-4bb4-b5e8-4cecb68b8f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.651821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 770/1561] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.652638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218439ae-8250-4bb4-b5e8-4cecb68b8f5a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.662633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218439ae-8250-4bb4-b5e8-4cecb68b8f5a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.667144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741739f-dd7d-43fd-8d01-9fc114abf0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.667893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741739f-dd7d-43fd-8d01-9fc114abf0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.668175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741739f-dd7d-43fd-8d01-9fc114abf0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.668452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741739f-dd7d-43fd-8d01-9fc114abf0e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.669169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741739f-dd7d-43fd-8d01-9fc114abf0e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:51:39.669474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741739f-dd7d-43fd-8d01-9fc114abf0e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.671085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741739f-dd7d-43fd-8d01-9fc114abf0e2 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.683418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 771/1562] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:51:39.684696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ecb9-3add-4881-ab5b-38eeb109f0ec None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.688926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ecb9-3add-4881-ab5b-38eeb109f0ec None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.688926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ecb9-3add-4881-ab5b-38eeb109f0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.706228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5e98ecb9-3add-4881-ab5b-38eeb109f0ec None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:39.707473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5e98ecb9-3add-4881-ab5b-38eeb109f0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:39.715716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 792/1563] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/projects => generated 407 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:39.716523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720018fa-e0d8-494d-a225-e266bae16f28 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.720720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:39.722103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 772/1564] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:39.722933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ecb9-3add-4881-ab5b-38eeb109f0ec None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.737158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ecb9-3add-4881-ab5b-38eeb109f0ec None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.761403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:39.789520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720018fa-e0d8-494d-a225-e266bae16f28 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.794958 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909b4cb-6512-4790-9780-9d03178c0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.795721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909b4cb-6512-4790-9780-9d03178c0d4d admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.796002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909b4cb-6512-4790-9780-9d03178c0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.796281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909b4cb-6512-4790-9780-9d03178c0d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.796995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909b4cb-6512-4790-9780-9d03178c0d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.798953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909b4cb-6512-4790-9780-9d03178c0d4d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.813293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b217077-feae-490b-949f-b21c85e8ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.813977 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b217077-feae-490b-949f-b21c85e8ed02 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.814259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b217077-feae-490b-949f-b21c85e8ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.814541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b217077-feae-490b-949f-b21c85e8ed02 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.815380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b217077-feae-490b-949f-b21c85e8ed02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:51:39.820872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b217077-feae-490b-949f-b21c85e8ed02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.820872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b217077-feae-490b-949f-b21c85e8ed02 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.832939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 773/1565] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:51:39.834513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b217077-feae-490b-949f-b21c85e8ed02 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.844986 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b217077-feae-490b-949f-b21c85e8ed02 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:39.851014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5704022-f637-4565-986e-9d2ddcff2491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:39.851824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5704022-f637-4565-986e-9d2ddcff2491 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:39.851922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5704022-f637-4565-986e-9d2ddcff2491 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:39.852127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5704022-f637-4565-986e-9d2ddcff2491 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:39.852857 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5704022-f637-4565-986e-9d2ddcff2491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:39.854816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5704022-f637-4565-986e-9d2ddcff2491 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:39.946255 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 793/1566] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:39.947192 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909b4cb-6512-4790-9780-9d03178c0d4d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.977316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 774/1567] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:39 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:39.981601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5704022-f637-4565-986e-9d2ddcff2491 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:39.995268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5704022-f637-4565-986e-9d2ddcff2491 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.038982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909b4cb-6512-4790-9780-9d03178c0d4d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.047470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e1ad2-4d87-468e-b170-e96b75ea8c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.048157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1ad2-4d87-468e-b170-e96b75ea8c5f admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.048448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1ad2-4d87-468e-b170-e96b75ea8c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.048732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e1ad2-4d87-468e-b170-e96b75ea8c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.049473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e1ad2-4d87-468e-b170-e96b75ea8c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.051103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e1ad2-4d87-468e-b170-e96b75ea8c5f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.062497 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4bda4-67f1-4790-9ae2-50393209d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.063179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4bda4-67f1-4790-9ae2-50393209d0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.063495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4bda4-67f1-4790-9ae2-50393209d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.063769 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4bda4-67f1-4790-9ae2-50393209d0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.064487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4bda4-67f1-4790-9ae2-50393209d0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:51:40.064838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4bda4-67f1-4790-9ae2-50393209d0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.065425 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 794/1568] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:40.066265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e1ad2-4d87-468e-b170-e96b75ea8c5f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.066496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4bda4-67f1-4790-9ae2-50393209d0a9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.079470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 775/1569] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:51:40.080310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4bda4-67f1-4790-9ae2-50393209d0a9 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.081277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e1ad2-4d87-468e-b170-e96b75ea8c5f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.087499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b791df-ace9-47ea-a565-ff296e5dad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.088225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b791df-ace9-47ea-a565-ff296e5dad13 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.088678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b791df-ace9-47ea-a565-ff296e5dad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.089145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b791df-ace9-47ea-a565-ff296e5dad13 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.089960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b791df-ace9-47ea-a565-ff296e5dad13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.091947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b791df-ace9-47ea-a565-ff296e5dad13 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.092572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4bda4-67f1-4790-9ae2-50393209d0a9 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.097492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcae6c-5204-4156-a73e-1af7577b6f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.098202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcae6c-5204-4156-a73e-1af7577b6f6b admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.098463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcae6c-5204-4156-a73e-1af7577b6f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.098874 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcae6c-5204-4156-a73e-1af7577b6f6b admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.100600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcae6c-5204-4156-a73e-1af7577b6f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.102557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcae6c-5204-4156-a73e-1af7577b6f6b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.183128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 795/1570] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:40 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:40.184379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b791df-ace9-47ea-a565-ff296e5dad13 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.213334 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 776/1571] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:40 2022] POST /identity/v3/users => generated 304 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:40.213334 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcae6c-5204-4156-a73e-1af7577b6f6b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.224286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcae6c-5204-4156-a73e-1af7577b6f6b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.254050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b791df-ace9-47ea-a565-ff296e5dad13 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.265554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f71ca-a5fe-43c5-84cc-e54c3f6586d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.266258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f71ca-a5fe-43c5-84cc-e54c3f6586d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.266537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f71ca-a5fe-43c5-84cc-e54c3f6586d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.266814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f71ca-a5fe-43c5-84cc-e54c3f6586d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.267579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f71ca-a5fe-43c5-84cc-e54c3f6586d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:51:40.267884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f71ca-a5fe-43c5-84cc-e54c3f6586d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.269746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f71ca-a5fe-43c5-84cc-e54c3f6586d7 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.273749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:40.285210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 796/1572] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:51:40.288180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f71ca-a5fe-43c5-84cc-e54c3f6586d7 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.290602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b318a-1c57-472d-8298-a36ee2712caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.291296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b318a-1c57-472d-8298-a36ee2712caa admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.291616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b318a-1c57-472d-8298-a36ee2712caa admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.292016 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b318a-1c57-472d-8298-a36ee2712caa admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.292745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b318a-1c57-472d-8298-a36ee2712caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.294692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b318a-1c57-472d-8298-a36ee2712caa admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.299606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f71ca-a5fe-43c5-84cc-e54c3f6586d7 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.304908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c461ed1-ee69-43fd-8f0d-79bfe92ebc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.305593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c461ed1-ee69-43fd-8f0d-79bfe92ebc05 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.305882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c461ed1-ee69-43fd-8f0d-79bfe92ebc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.306167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c461ed1-ee69-43fd-8f0d-79bfe92ebc05 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.306861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c461ed1-ee69-43fd-8f0d-79bfe92ebc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.308866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c461ed1-ee69-43fd-8f0d-79bfe92ebc05 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.416485 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 777/1573] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:40 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:40.417340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b318a-1c57-472d-8298-a36ee2712caa admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.421450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:40.454597 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 797/1574] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:40 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:40.455534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c461ed1-ee69-43fd-8f0d-79bfe92ebc05 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.466804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c461ed1-ee69-43fd-8f0d-79bfe92ebc05 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.492479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b318a-1c57-472d-8298-a36ee2712caa admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.499236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefa050-1f2d-4b41-ba95-00305832b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.499977 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefa050-1f2d-4b41-ba95-00305832b411 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.500260 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefa050-1f2d-4b41-ba95-00305832b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.500536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefa050-1f2d-4b41-ba95-00305832b411 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.504562 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefa050-1f2d-4b41-ba95-00305832b411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.504562 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefa050-1f2d-4b41-ba95-00305832b411 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.513835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 778/1575] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:40.514662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefa050-1f2d-4b41-ba95-00305832b411 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.526017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefa050-1f2d-4b41-ba95-00305832b411 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.532701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f82075-6f6a-4acb-a4f9-3e95919c67c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.532871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c399b7e-3e02-4a8a-bacf-a485c7e4ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.533469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f82075-6f6a-4acb-a4f9-3e95919c67c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.533587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c399b7e-3e02-4a8a-bacf-a485c7e4ee4d admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.533849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f82075-6f6a-4acb-a4f9-3e95919c67c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.534068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c399b7e-3e02-4a8a-bacf-a485c7e4ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.534248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c399b7e-3e02-4a8a-bacf-a485c7e4ee4d admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.534423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f82075-6f6a-4acb-a4f9-3e95919c67c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.534930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c399b7e-3e02-4a8a-bacf-a485c7e4ee4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.535284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f82075-6f6a-4acb-a4f9-3e95919c67c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.536871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c399b7e-3e02-4a8a-bacf-a485c7e4ee4d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.537185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f82075-6f6a-4acb-a4f9-3e95919c67c6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.553677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 798/1576] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:40.553677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f82075-6f6a-4acb-a4f9-3e95919c67c6 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.559991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f82075-6f6a-4acb-a4f9-3e95919c67c6 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.564886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c173-f519-4269-81e3-c5fe581a2128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.565536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c173-f519-4269-81e3-c5fe581a2128 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.565833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c173-f519-4269-81e3-c5fe581a2128 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.566097 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c173-f519-4269-81e3-c5fe581a2128 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.566783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5c173-f519-4269-81e3-c5fe581a2128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.568723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5c173-f519-4269-81e3-c5fe581a2128 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.646038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 779/1577] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:40 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:40.646907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c399b7e-3e02-4a8a-bacf-a485c7e4ee4d admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.656936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 799/1578] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:40 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:40.657966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c173-f519-4269-81e3-c5fe581a2128 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.668655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c173-f519-4269-81e3-c5fe581a2128 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.717202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c399b7e-3e02-4a8a-bacf-a485c7e4ee4d admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.721914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e4571-49be-4db1-b34f-a3b3676ac7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.722575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e4571-49be-4db1-b34f-a3b3676ac7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.722876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e4571-49be-4db1-b34f-a3b3676ac7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.723128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e4571-49be-4db1-b34f-a3b3676ac7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.723875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e4571-49be-4db1-b34f-a3b3676ac7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.725455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e4571-49be-4db1-b34f-a3b3676ac7e6 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.730014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d21db-3ac1-4437-b37a-4caabda0ca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.732229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d21db-3ac1-4437-b37a-4caabda0ca4e admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.732229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d21db-3ac1-4437-b37a-4caabda0ca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.732229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d21db-3ac1-4437-b37a-4caabda0ca4e admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.732229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d21db-3ac1-4437-b37a-4caabda0ca4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.734240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d21db-3ac1-4437-b37a-4caabda0ca4e admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.736920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 780/1579] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:40.737729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e4571-49be-4db1-b34f-a3b3676ac7e6 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.748080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e4571-49be-4db1-b34f-a3b3676ac7e6 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.752832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583a26f-281a-4bca-aba5-0532fde01078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.753491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583a26f-281a-4bca-aba5-0532fde01078 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.753776 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583a26f-281a-4bca-aba5-0532fde01078 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.755236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583a26f-281a-4bca-aba5-0532fde01078 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.755236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583a26f-281a-4bca-aba5-0532fde01078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.756741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583a26f-281a-4bca-aba5-0532fde01078 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.839699 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 800/1580] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:40 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:40.840688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d21db-3ac1-4437-b37a-4caabda0ca4e admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.861915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 781/1581] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:40 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:40.861915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583a26f-281a-4bca-aba5-0532fde01078 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.874541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583a26f-281a-4bca-aba5-0532fde01078 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.887610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:40.906217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d21db-3ac1-4437-b37a-4caabda0ca4e admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.911366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8e483-8fce-4fcf-abb3-c23262635e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.912055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8e483-8fce-4fcf-abb3-c23262635e25 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.912339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8e483-8fce-4fcf-abb3-c23262635e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.912618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8e483-8fce-4fcf-abb3-c23262635e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.913488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8e483-8fce-4fcf-abb3-c23262635e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.915196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8e483-8fce-4fcf-abb3-c23262635e25 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.925861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 801/1582] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:40.929428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8e483-8fce-4fcf-abb3-c23262635e25 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.934685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:40.942357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedbf7f-e8c7-40ff-b4a7-ceaa76158310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.943030 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedbf7f-e8c7-40ff-b4a7-ceaa76158310 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.943257 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8e483-8fce-4fcf-abb3-c23262635e25 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.943375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedbf7f-e8c7-40ff-b4a7-ceaa76158310 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.943602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedbf7f-e8c7-40ff-b4a7-ceaa76158310 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.944894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedbf7f-e8c7-40ff-b4a7-ceaa76158310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.946496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedbf7f-e8c7-40ff-b4a7-ceaa76158310 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.948920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6113fb-b019-4f25-a86a-9a1fba454826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.949816 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6113fb-b019-4f25-a86a-9a1fba454826 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.950102 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6113fb-b019-4f25-a86a-9a1fba454826 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.950448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6113fb-b019-4f25-a86a-9a1fba454826 admin admin] PATH_INFO: `/v3/projects/e06c8d8aad664fd2a55e9e871bc9842a/users/65143f81d67b4a33b50540d0d6da13fa/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.961231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 782/1583] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:40.961231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedbf7f-e8c7-40ff-b4a7-ceaa76158310 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:40.973261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedbf7f-e8c7-40ff-b4a7-ceaa76158310 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:40.973544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6113fb-b019-4f25-a86a-9a1fba454826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06c8d8aad664fd2a55e9e871bc9842a, user_id=65143f81d67b4a33b50540d0d6da13fa, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.973544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: WARNING py.warnings [None req-8c6113fb-b019-4f25-a86a-9a1fba454826 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:51:40.973544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: warnings.warn(msg) Jun 17 08:51:40.973544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: Jun 17 08:51:40.974161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dfbc8-370b-4cc9-b0b0-db409798ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:40.974495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dfbc8-370b-4cc9-b0b0-db409798ac1c admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:40.974773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dfbc8-370b-4cc9-b0b0-db409798ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:40.975046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dfbc8-370b-4cc9-b0b0-db409798ac1c admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:40.975221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6113fb-b019-4f25-a86a-9a1fba454826 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:40.975925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dfbc8-370b-4cc9-b0b0-db409798ac1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:40.978019 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dfbc8-370b-4cc9-b0b0-db409798ac1c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.067023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 802/1584] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:40 2022] PUT /identity/v3/projects/e06c8d8aad664fd2a55e9e871bc9842a/users/65143f81d67b4a33b50540d0d6da13fa/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:41.067919 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6113fb-b019-4f25-a86a-9a1fba454826 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.092399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 783/1585] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:40 2022] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:41.093421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dfbc8-370b-4cc9-b0b0-db409798ac1c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.104010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dfbc8-370b-4cc9-b0b0-db409798ac1c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.141897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6113fb-b019-4f25-a86a-9a1fba454826 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.146904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d055e-d1c1-4d7c-b102-d51ffcc9a12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.148248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d055e-d1c1-4d7c-b102-d51ffcc9a12d admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.148535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d055e-d1c1-4d7c-b102-d51ffcc9a12d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.149008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d055e-d1c1-4d7c-b102-d51ffcc9a12d admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.149744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d055e-d1c1-4d7c-b102-d51ffcc9a12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.151458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d055e-d1c1-4d7c-b102-d51ffcc9a12d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.161824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 803/1586] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:41.162638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d055e-d1c1-4d7c-b102-d51ffcc9a12d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.171488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb60388-a4c1-46c7-a186-8c6f1e5da9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.172159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb60388-a4c1-46c7-a186-8c6f1e5da9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.172439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb60388-a4c1-46c7-a186-8c6f1e5da9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.172711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb60388-a4c1-46c7-a186-8c6f1e5da9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.173431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb60388-a4c1-46c7-a186-8c6f1e5da9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.175082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb60388-a4c1-46c7-a186-8c6f1e5da9e8 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.182394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d055e-d1c1-4d7c-b102-d51ffcc9a12d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.186071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 784/1587] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:41.187101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb60388-a4c1-46c7-a186-8c6f1e5da9e8 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.192490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af5118-586a-4b58-94c4-51cb3859abc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.193553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af5118-586a-4b58-94c4-51cb3859abc3 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.194007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af5118-586a-4b58-94c4-51cb3859abc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.194986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af5118-586a-4b58-94c4-51cb3859abc3 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.196173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af5118-586a-4b58-94c4-51cb3859abc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.198121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb60388-a4c1-46c7-a186-8c6f1e5da9e8 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.199499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af5118-586a-4b58-94c4-51cb3859abc3 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.202953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ce056-702b-45e8-98d1-220f2e7d2b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.203659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ce056-702b-45e8-98d1-220f2e7d2b4f admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.203936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ce056-702b-45e8-98d1-220f2e7d2b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.204211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ce056-702b-45e8-98d1-220f2e7d2b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.204926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ce056-702b-45e8-98d1-220f2e7d2b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.206535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ce056-702b-45e8-98d1-220f2e7d2b4f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.220471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 785/1588] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:41.224331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ce056-702b-45e8-98d1-220f2e7d2b4f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.231712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ce056-702b-45e8-98d1-220f2e7d2b4f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.236302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aea886-316c-4eec-bcf0-01ad3b787a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.237001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aea886-316c-4eec-bcf0-01ad3b787a34 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.237313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aea886-316c-4eec-bcf0-01ad3b787a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.237594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aea886-316c-4eec-bcf0-01ad3b787a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.238298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aea886-316c-4eec-bcf0-01ad3b787a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.239906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aea886-316c-4eec-bcf0-01ad3b787a34 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.250957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 786/1589] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:41.252711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aea886-316c-4eec-bcf0-01ad3b787a34 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.263230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aea886-316c-4eec-bcf0-01ad3b787a34 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.267853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244cf01-6db5-4a55-85ce-c6225e647eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.268749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244cf01-6db5-4a55-85ce-c6225e647eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.269244 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244cf01-6db5-4a55-85ce-c6225e647eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.269358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244cf01-6db5-4a55-85ce-c6225e647eb7 admin admin] PATH_INFO: `/v3/projects/2bfcf91b0c2b42ccab1c652c7b7fd5ac/users/5a6152b8f4cd472a983a5e87eab11391/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.284650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244cf01-6db5-4a55-85ce-c6225e647eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bfcf91b0c2b42ccab1c652c7b7fd5ac, user_id=5a6152b8f4cd472a983a5e87eab11391, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.287263 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244cf01-6db5-4a55-85ce-c6225e647eb7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.307912 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 804/1590] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:41 2022] POST /identity/v3/users => generated 284 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:41.309189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed4ee-5509-49f7-b91e-43929f9d3cbc None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.309472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed4ee-5509-49f7-b91e-43929f9d3cbc None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.309795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ed4ee-5509-49f7-b91e-43929f9d3cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.335900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-9f7ed4ee-5509-49f7-b91e-43929f9d3cbc None None] MFA Rules not processed for user `65143f81d67b4a33b50540d0d6da13fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:41.337091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9f7ed4ee-5509-49f7-b91e-43929f9d3cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:41.394230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 787/1591] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:41 2022] PUT /identity/v3/projects/2bfcf91b0c2b42ccab1c652c7b7fd5ac/users/5a6152b8f4cd472a983a5e87eab11391/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:41.395225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244cf01-6db5-4a55-85ce-c6225e647eb7 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.402225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 805/1592] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:41.403110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ed4ee-5509-49f7-b91e-43929f9d3cbc None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.420434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ed4ee-5509-49f7-b91e-43929f9d3cbc None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.450041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:41.472315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244cf01-6db5-4a55-85ce-c6225e647eb7 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.478216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca185420-932c-4721-b9c6-f38ccf2bb6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.478818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca185420-932c-4721-b9c6-f38ccf2bb6fe admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.479103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca185420-932c-4721-b9c6-f38ccf2bb6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.479401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca185420-932c-4721-b9c6-f38ccf2bb6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.480126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca185420-932c-4721-b9c6-f38ccf2bb6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.481829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca185420-932c-4721-b9c6-f38ccf2bb6fe admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.490573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e506ad-7696-4f0b-a9f9-8568bda32293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.492023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e506ad-7696-4f0b-a9f9-8568bda32293 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.492237 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e506ad-7696-4f0b-a9f9-8568bda32293 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.492738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e506ad-7696-4f0b-a9f9-8568bda32293 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.493667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 788/1593] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:41.493840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e506ad-7696-4f0b-a9f9-8568bda32293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.494505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca185420-932c-4721-b9c6-f38ccf2bb6fe admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.495527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e506ad-7696-4f0b-a9f9-8568bda32293 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.505056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca185420-932c-4721-b9c6-f38ccf2bb6fe admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.507691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 806/1594] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:41.508426 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e506ad-7696-4f0b-a9f9-8568bda32293 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.511721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a5729-390b-49f5-85e2-0322a982238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.513132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a5729-390b-49f5-85e2-0322a982238b admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.513603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a5729-390b-49f5-85e2-0322a982238b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.514067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a5729-390b-49f5-85e2-0322a982238b admin admin] PATH_INFO: `/v3/projects/195b0adcf9f14419a3ec66c1ca374b86/users/a1a1aadce7ca4b05b618e6a2cb0c95d2/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.518451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e506ad-7696-4f0b-a9f9-8568bda32293 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.523582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e23b07-2136-4a2e-8aa0-21b7da9e0dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.527162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23b07-2136-4a2e-8aa0-21b7da9e0dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.527162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23b07-2136-4a2e-8aa0-21b7da9e0dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.527162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23b07-2136-4a2e-8aa0-21b7da9e0dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.527162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e23b07-2136-4a2e-8aa0-21b7da9e0dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.527162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e23b07-2136-4a2e-8aa0-21b7da9e0dd0 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.530747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a5729-390b-49f5-85e2-0322a982238b admin admin] RBAC: Authorizing `identity:create_grant(project_id=195b0adcf9f14419a3ec66c1ca374b86, user_id=a1a1aadce7ca4b05b618e6a2cb0c95d2, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.533408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a5729-390b-49f5-85e2-0322a982238b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.536718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:41.537731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 807/1595] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:41.539504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e23b07-2136-4a2e-8aa0-21b7da9e0dd0 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.549065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e23b07-2136-4a2e-8aa0-21b7da9e0dd0 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.553737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f9372-86be-4f74-aeb0-7c0ba7816f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.554722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f9372-86be-4f74-aeb0-7c0ba7816f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.555382 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f9372-86be-4f74-aeb0-7c0ba7816f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.555382 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f9372-86be-4f74-aeb0-7c0ba7816f60 admin admin] PATH_INFO: `/v3/projects/794e7ebcf5c3436081b8e8d39907b655/users/01bb3df8b4b649388d1a0f6c24e18f1b/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.574254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f9372-86be-4f74-aeb0-7c0ba7816f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794e7ebcf5c3436081b8e8d39907b655, user_id=01bb3df8b4b649388d1a0f6c24e18f1b, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.576967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f9372-86be-4f74-aeb0-7c0ba7816f60 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.598987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 789/1596] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:41 2022] PUT /identity/v3/projects/195b0adcf9f14419a3ec66c1ca374b86/users/a1a1aadce7ca4b05b618e6a2cb0c95d2/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:41.601316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a5729-390b-49f5-85e2-0322a982238b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.667932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a5729-390b-49f5-85e2-0322a982238b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.673043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 808/1597] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:41 2022] PUT /identity/v3/projects/794e7ebcf5c3436081b8e8d39907b655/users/01bb3df8b4b649388d1a0f6c24e18f1b/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:41.676223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50564fc-1b76-4f61-8a66-34102b8777af None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.676223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50564fc-1b76-4f61-8a66-34102b8777af None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.676223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50564fc-1b76-4f61-8a66-34102b8777af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.702593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a50564fc-1b76-4f61-8a66-34102b8777af None None] MFA Rules not processed for user `5a6152b8f4cd472a983a5e87eab11391`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:41.703827 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a50564fc-1b76-4f61-8a66-34102b8777af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:41.727208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89026cc6-ee60-46ae-bd3f-72075a55e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.728461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026cc6-ee60-46ae-bd3f-72075a55e7fc admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.728461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026cc6-ee60-46ae-bd3f-72075a55e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.728461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89026cc6-ee60-46ae-bd3f-72075a55e7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.729152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89026cc6-ee60-46ae-bd3f-72075a55e7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.730813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89026cc6-ee60-46ae-bd3f-72075a55e7fc admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.741382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 790/1598] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:41.742717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159ce97-b549-4626-98fa-6c449b218bf6 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.743007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159ce97-b549-4626-98fa-6c449b218bf6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.743286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159ce97-b549-4626-98fa-6c449b218bf6 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.744554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 791/1599] 10.222.0.78 () {54 vars in 961 bytes} [Fri Jun 17 08:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:51:41.745250 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159ce97-b549-4626-98fa-6c449b218bf6 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.758325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159ce97-b549-4626-98fa-6c449b218bf6 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.762797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1a999-e086-491e-b54b-69d8cee27475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.763483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1a999-e086-491e-b54b-69d8cee27475 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.763767 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1a999-e086-491e-b54b-69d8cee27475 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.764044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1a999-e086-491e-b54b-69d8cee27475 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.764755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1a999-e086-491e-b54b-69d8cee27475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.766344 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1a999-e086-491e-b54b-69d8cee27475 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.774466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 809/1600] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:41.775537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50564fc-1b76-4f61-8a66-34102b8777af None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.777744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 792/1601] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:41.778906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1a999-e086-491e-b54b-69d8cee27475 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:41.791195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1a999-e086-491e-b54b-69d8cee27475 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.791878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50564fc-1b76-4f61-8a66-34102b8777af None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:41.797120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca69dc-ac49-46de-b861-881ea3d094b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.797890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88f21-2051-4a67-8e59-89e064e833f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:41.798038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca69dc-ac49-46de-b861-881ea3d094b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.798450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca69dc-ac49-46de-b861-881ea3d094b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.798731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca69dc-ac49-46de-b861-881ea3d094b6 admin admin] PATH_INFO: `/v3/projects/b493dbf75ed64a7dbda3e9c6a6168f8f/users/b0eb46b0aeeb46fe8dcdb02f29ae4013/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.798846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88f21-2051-4a67-8e59-89e064e833f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.799103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88f21-2051-4a67-8e59-89e064e833f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.799430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88f21-2051-4a67-8e59-89e064e833f0 admin admin] PATH_INFO: `/v3/projects/63675a395d824db687bca143dc25c3b2/users/72e4c92b149c4dffbdeba414d8803bf8/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.815329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca69dc-ac49-46de-b861-881ea3d094b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b493dbf75ed64a7dbda3e9c6a6168f8f, user_id=b0eb46b0aeeb46fe8dcdb02f29ae4013, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.818016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca69dc-ac49-46de-b861-881ea3d094b6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.822447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd88f21-2051-4a67-8e59-89e064e833f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63675a395d824db687bca143dc25c3b2, user_id=72e4c92b149c4dffbdeba414d8803bf8, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:41.825254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd88f21-2051-4a67-8e59-89e064e833f0 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:41.914853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 810/1602] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:41 2022] PUT /identity/v3/projects/b493dbf75ed64a7dbda3e9c6a6168f8f/users/b0eb46b0aeeb46fe8dcdb02f29ae4013/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:41.916922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7448b2-9ff0-4111-97ba-cf3bf51009d7 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.922840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7448b2-9ff0-4111-97ba-cf3bf51009d7 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.922840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7448b2-9ff0-4111-97ba-cf3bf51009d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.925477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 793/1603] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:41 2022] PUT /identity/v3/projects/63675a395d824db687bca143dc25c3b2/users/72e4c92b149c4dffbdeba414d8803bf8/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:41.926896 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8e6c-ea1a-4f14-9b90-bfa09522d486 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:41.927197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8e6c-ea1a-4f14-9b90-bfa09522d486 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:41.927501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8e6c-ea1a-4f14-9b90-bfa09522d486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:41.947611 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9f0e8e6c-ea1a-4f14-9b90-bfa09522d486 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:41.948854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9f0e8e6c-ea1a-4f14-9b90-bfa09522d486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:41.954737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-fb7448b2-9ff0-4111-97ba-cf3bf51009d7 None None] MFA Rules not processed for user `a1a1aadce7ca4b05b618e6a2cb0c95d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:41.956253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-fb7448b2-9ff0-4111-97ba-cf3bf51009d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:41.999379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:42.013801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 794/1604] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:42.014787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e8e6c-ea1a-4f14-9b90-bfa09522d486 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:42.026933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:42.027441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 811/1605] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:42.030879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085c71-325f-49e0-9cc7-21985d0f6f55 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.030879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085c71-325f-49e0-9cc7-21985d0f6f55 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.030879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085c71-325f-49e0-9cc7-21985d0f6f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.031792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e8e6c-ea1a-4f14-9b90-bfa09522d486 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:42.036678 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541cb1c-0533-4192-9f5f-f14ef048f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:42.037386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541cb1c-0533-4192-9f5f-f14ef048f3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.037672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541cb1c-0533-4192-9f5f-f14ef048f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.038033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541cb1c-0533-4192-9f5f-f14ef048f3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.038961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541cb1c-0533-4192-9f5f-f14ef048f3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:42.040608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541cb1c-0533-4192-9f5f-f14ef048f3b2 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:42.048006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-24085c71-325f-49e0-9cc7-21985d0f6f55 None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:42.049230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-24085c71-325f-49e0-9cc7-21985d0f6f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:42.056873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 795/1606] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:42.057823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541cb1c-0533-4192-9f5f-f14ef048f3b2 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:42.068538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541cb1c-0533-4192-9f5f-f14ef048f3b2 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:42.074134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a1861-8a22-40ce-9dc7-54269e5b3315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:42.075945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1861-8a22-40ce-9dc7-54269e5b3315 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.075945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1861-8a22-40ce-9dc7-54269e5b3315 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.075945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1861-8a22-40ce-9dc7-54269e5b3315 admin admin] PATH_INFO: `/v3/projects/2fe51fc742db40199cb57db1f9548553/users/648670aa855a4f7185c621b7006774da/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.090839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a1861-8a22-40ce-9dc7-54269e5b3315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe51fc742db40199cb57db1f9548553, user_id=648670aa855a4f7185c621b7006774da, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:42.093545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a1861-8a22-40ce-9dc7-54269e5b3315 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:42.125367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 812/1607] 10.222.0.78 () {58 vars in 1058 bytes} [Fri Jun 17 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:42.128722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b60d2-afda-467c-add9-bf528d980ac2 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.129067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b60d2-afda-467c-add9-bf528d980ac2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.129290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b60d2-afda-467c-add9-bf528d980ac2 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.130831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 813/1608] 10.222.0.78 () {54 vars in 961 bytes} [Fri Jun 17 08:51:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:51:42.133023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b77b97-091c-485a-9c64-9d6c83ec76b6 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.133023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b77b97-091c-485a-9c64-9d6c83ec76b6 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.133023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b77b97-091c-485a-9c64-9d6c83ec76b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.150635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a0b77b97-091c-485a-9c64-9d6c83ec76b6 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:42.151900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a0b77b97-091c-485a-9c64-9d6c83ec76b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:42.159683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 796/1609] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:42 2022] PUT /identity/v3/projects/2fe51fc742db40199cb57db1f9548553/users/648670aa855a4f7185c621b7006774da/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:42.160993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d245495-6d43-44ca-9e7f-6f11af076c6a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.161280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d245495-6d43-44ca-9e7f-6f11af076c6a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.161557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d245495-6d43-44ca-9e7f-6f11af076c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.183186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-4d245495-6d43-44ca-9e7f-6f11af076c6a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:42.184931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4d245495-6d43-44ca-9e7f-6f11af076c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:42.215058 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 814/1610] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:42.216182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b77b97-091c-485a-9c64-9d6c83ec76b6 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:42.217461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a0b77b97-091c-485a-9c64-9d6c83ec76b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:42.255724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 797/1611] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:42.256447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d245495-6d43-44ca-9e7f-6f11af076c6a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:42.267944 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d245495-6d43-44ca-9e7f-6f11af076c6a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:42.272909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc2fb8-873e-4561-b52d-9ca861ff04ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:42.273685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc2fb8-873e-4561-b52d-9ca861ff04ca admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.273960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc2fb8-873e-4561-b52d-9ca861ff04ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.274229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc2fb8-873e-4561-b52d-9ca861ff04ca admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.274947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc2fb8-873e-4561-b52d-9ca861ff04ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:42.276910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc2fb8-873e-4561-b52d-9ca861ff04ca admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:42.280231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b77b97-091c-485a-9c64-9d6c83ec76b6 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:42.284627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551823f-800b-4f90-9712-6c78e47fb073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:42.285358 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551823f-800b-4f90-9712-6c78e47fb073 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.285643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551823f-800b-4f90-9712-6c78e47fb073 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.285985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551823f-800b-4f90-9712-6c78e47fb073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.295887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551823f-800b-4f90-9712-6c78e47fb073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:42.297334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551823f-800b-4f90-9712-6c78e47fb073 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:42.307864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 815/1612] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:42.308630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551823f-800b-4f90-9712-6c78e47fb073 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:42.317977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551823f-800b-4f90-9712-6c78e47fb073 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:42.323649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3e9e4-bb49-4fb9-b471-5fd8249ccdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:42.324522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3e9e4-bb49-4fb9-b471-5fd8249ccdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.324809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3e9e4-bb49-4fb9-b471-5fd8249ccdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.325090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3e9e4-bb49-4fb9-b471-5fd8249ccdf9 admin admin] PATH_INFO: `/v3/projects/8f743036f812432b8f6be62f76c29570/users/89d3453f12bf42d484519a88ac0e2984/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.336828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:42.340656 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3e9e4-bb49-4fb9-b471-5fd8249ccdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f743036f812432b8f6be62f76c29570, user_id=89d3453f12bf42d484519a88ac0e2984, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:42.343314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3e9e4-bb49-4fb9-b471-5fd8249ccdf9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:42.400602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 798/1613] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:42 2022] POST /identity/v3/projects => generated 407 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:42.401715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc2fb8-873e-4561-b52d-9ca861ff04ca admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:42.437578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 816/1614] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:42 2022] PUT /identity/v3/projects/8f743036f812432b8f6be62f76c29570/users/89d3453f12bf42d484519a88ac0e2984/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:42.438768 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8027d-2036-4bd5-a635-d7daadeaa6c8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.439059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8027d-2036-4bd5-a635-d7daadeaa6c8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.439338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8027d-2036-4bd5-a635-d7daadeaa6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.465166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-0ed8027d-2036-4bd5-a635-d7daadeaa6c8 None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:42.465830 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0ed8027d-2036-4bd5-a635-d7daadeaa6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:42.489302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc2fb8-873e-4561-b52d-9ca861ff04ca admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:42.542779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:42.549511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 817/1615] 10.222.0.78 () {58 vars in 1058 bytes} [Fri Jun 17 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:42.550594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad70e4b-af92-4f2f-be0d-b397a80370e7 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.550878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad70e4b-af92-4f2f-be0d-b397a80370e7 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.551178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad70e4b-af92-4f2f-be0d-b397a80370e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.571223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38f230-4d86-4e80-bc35-253c1e6f76e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:42.572006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38f230-4d86-4e80-bc35-253c1e6f76e4 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.572359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38f230-4d86-4e80-bc35-253c1e6f76e4 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.572640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38f230-4d86-4e80-bc35-253c1e6f76e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.579380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-4ad70e4b-af92-4f2f-be0d-b397a80370e7 None None] MFA Rules not processed for user `648670aa855a4f7185c621b7006774da`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:42.580974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4ad70e4b-af92-4f2f-be0d-b397a80370e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:42.638036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38f230-4d86-4e80-bc35-253c1e6f76e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:42.639775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38f230-4d86-4e80-bc35-253c1e6f76e4 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:42.656485 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 799/1616] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:42.656814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 818/1617] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:42.656910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38f230-4d86-4e80-bc35-253c1e6f76e4 service nova] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:42.657663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad70e4b-af92-4f2f-be0d-b397a80370e7 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:42.756625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad70e4b-af92-4f2f-be0d-b397a80370e7 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:42.762081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1b088-a2ea-4175-a2f6-86daf08659b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:42.762905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38f230-4d86-4e80-bc35-253c1e6f76e4 service nova] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:42.763438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b088-a2ea-4175-a2f6-86daf08659b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.763970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b088-a2ea-4175-a2f6-86daf08659b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.764697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b088-a2ea-4175-a2f6-86daf08659b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.767415 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d4b52-e6fb-4c36-b6a8-8dc94b5f36e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:42.768079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4b52-e6fb-4c36-b6a8-8dc94b5f36e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.768415 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4b52-e6fb-4c36-b6a8-8dc94b5f36e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.768890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4b52-e6fb-4c36-b6a8-8dc94b5f36e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.800997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:42.837831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1b088-a2ea-4175-a2f6-86daf08659b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:42.839620 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1b088-a2ea-4175-a2f6-86daf08659b4 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:42.851153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 819/1618] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:42.852350 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1b088-a2ea-4175-a2f6-86daf08659b4 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:42.853553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d4b52-e6fb-4c36-b6a8-8dc94b5f36e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:42.855833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d4b52-e6fb-4c36-b6a8-8dc94b5f36e4 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:42.864587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1b088-a2ea-4175-a2f6-86daf08659b4 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:42.871738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 800/1619] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:42.871994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b3bf-abbe-484d-8082-2b3ba95b1be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:42.872692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b3bf-abbe-484d-8082-2b3ba95b1be9 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.873042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b3bf-abbe-484d-8082-2b3ba95b1be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.873330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b3bf-abbe-484d-8082-2b3ba95b1be9 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.874467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644b3bf-abbe-484d-8082-2b3ba95b1be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:42.874925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb47a0-d67d-4993-bef2-2443c3db741c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:42.875516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb47a0-d67d-4993-bef2-2443c3db741c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:42.876085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb47a0-d67d-4993-bef2-2443c3db741c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:42.876902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644b3bf-abbe-484d-8082-2b3ba95b1be9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:42.908259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-40fb47a0-d67d-4993-bef2-2443c3db741c None None] MFA Rules not processed for user `89d3453f12bf42d484519a88ac0e2984`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:42.909561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-40fb47a0-d67d-4993-bef2-2443c3db741c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:42.934683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:42.981074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 801/1620] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:42.981941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb47a0-d67d-4993-bef2-2443c3db741c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:42.997649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb47a0-d67d-4993-bef2-2443c3db741c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:43.003697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266f76a-9351-448b-b230-bc92eadf429d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:43.004383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266f76a-9351-448b-b230-bc92eadf429d service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.004752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266f76a-9351-448b-b230-bc92eadf429d service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.004945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266f76a-9351-448b-b230-bc92eadf429d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.013221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 820/1621] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:42 2022] POST /identity/v3/users => generated 310 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:43.013221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b3bf-abbe-484d-8082-2b3ba95b1be9 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:43.028141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b3bf-abbe-484d-8082-2b3ba95b1be9 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:43.033782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2f458-bc66-4d60-b874-fd635a180ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:43.034473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2f458-bc66-4d60-b874-fd635a180ebd admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.034757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2f458-bc66-4d60-b874-fd635a180ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.037400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2f458-bc66-4d60-b874-fd635a180ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.037400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2f458-bc66-4d60-b874-fd635a180ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:43.037831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2f458-bc66-4d60-b874-fd635a180ebd admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:43.084305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266f76a-9351-448b-b230-bc92eadf429d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:43.086951 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266f76a-9351-448b-b230-bc92eadf429d service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:43.100172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 802/1622] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:43.102529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d45a-ac95-4f2b-a8fe-20db4de26129 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.103041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d45a-ac95-4f2b-a8fe-20db4de26129 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.103570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d45a-ac95-4f2b-a8fe-20db4de26129 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.105503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 803/1623] 10.222.0.78 () {54 vars in 912 bytes} [Fri Jun 17 08:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:51:43.106784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d45a-ac95-4f2b-a8fe-20db4de26129 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:43.152462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 821/1624] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:43 2022] POST /identity/v3/projects => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:43.153649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2f458-bc66-4d60-b874-fd635a180ebd admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:43.224069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d45a-ac95-4f2b-a8fe-20db4de26129 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:43.294136 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2f458-bc66-4d60-b874-fd635a180ebd admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:43.308729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6aabb-e20c-48dd-b1ca-033b76833321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:43.309509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6aabb-e20c-48dd-b1ca-033b76833321 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.309509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6aabb-e20c-48dd-b1ca-033b76833321 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.309927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6aabb-e20c-48dd-b1ca-033b76833321 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.310835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6aabb-e20c-48dd-b1ca-033b76833321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:43.312500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6aabb-e20c-48dd-b1ca-033b76833321 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:43.331278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 822/1625] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:43.332604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414f061-1abc-41fd-aac8-82315fcac00b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.332917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414f061-1abc-41fd-aac8-82315fcac00b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.333495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414f061-1abc-41fd-aac8-82315fcac00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.334037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaac70f-a5bb-4ebf-a9fb-b75df0161e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:43.334696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaac70f-a5bb-4ebf-a9fb-b75df0161e52 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.335032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaac70f-a5bb-4ebf-a9fb-b75df0161e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.335310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaac70f-a5bb-4ebf-a9fb-b75df0161e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.375853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b414f061-1abc-41fd-aac8-82315fcac00b None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:43.377094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b414f061-1abc-41fd-aac8-82315fcac00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:43.396270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:43.439557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaac70f-a5bb-4ebf-a9fb-b75df0161e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:43.441286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaac70f-a5bb-4ebf-a9fb-b75df0161e52 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:43.454822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 804/1626] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:43.455926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaac70f-a5bb-4ebf-a9fb-b75df0161e52 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:43.469438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaac70f-a5bb-4ebf-a9fb-b75df0161e52 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:43.474853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06915926-02a7-4502-abf8-0f3e4c9e2059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:43.477080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06915926-02a7-4502-abf8-0f3e4c9e2059 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.477460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06915926-02a7-4502-abf8-0f3e4c9e2059 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.478207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06915926-02a7-4502-abf8-0f3e4c9e2059 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.479027 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06915926-02a7-4502-abf8-0f3e4c9e2059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:43.481790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06915926-02a7-4502-abf8-0f3e4c9e2059 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:43.542420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 823/1627] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:51:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:43.544253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414f061-1abc-41fd-aac8-82315fcac00b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:43.558997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414f061-1abc-41fd-aac8-82315fcac00b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:43.564700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07119b11-1474-44f9-907f-c1d7b290a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:43.565706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07119b11-1474-44f9-907f-c1d7b290a7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.566268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07119b11-1474-44f9-907f-c1d7b290a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.566723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07119b11-1474-44f9-907f-c1d7b290a7fe admin admin] PATH_INFO: `/v3/projects/20dfa666055748de98edfcdb7b46a4c3/users/5223855cf08a49fa8184091d1d1b98f3/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.570634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:43.583617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07119b11-1474-44f9-907f-c1d7b290a7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=20dfa666055748de98edfcdb7b46a4c3, user_id=5223855cf08a49fa8184091d1d1b98f3, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:43.588379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07119b11-1474-44f9-907f-c1d7b290a7fe admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:43.642717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 805/1628] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:43 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:43.642717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be41e-1241-4e5b-8d8b-ac74d9026572 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.642717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be41e-1241-4e5b-8d8b-ac74d9026572 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.642717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be41e-1241-4e5b-8d8b-ac74d9026572 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.643579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 806/1629] 10.222.0.78 () {54 vars in 912 bytes} [Fri Jun 17 08:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:51:43.644143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be41e-1241-4e5b-8d8b-ac74d9026572 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:43.658779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be41e-1241-4e5b-8d8b-ac74d9026572 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:43.665328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 824/1630] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:43 2022] PUT /identity/v3/projects/20dfa666055748de98edfcdb7b46a4c3/users/5223855cf08a49fa8184091d1d1b98f3/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:43.666536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07119b11-1474-44f9-907f-c1d7b290a7fe admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:43.746394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07119b11-1474-44f9-907f-c1d7b290a7fe admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:43.761673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183801-5592-4fc7-9c3f-f320fc972681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:43.762442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183801-5592-4fc7-9c3f-f320fc972681 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.762871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183801-5592-4fc7-9c3f-f320fc972681 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.763153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183801-5592-4fc7-9c3f-f320fc972681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.764934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dac89-d63a-4b19-9120-0db1a13b26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:43.765627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dac89-d63a-4b19-9120-0db1a13b26fc admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.765915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dac89-d63a-4b19-9120-0db1a13b26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.766197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dac89-d63a-4b19-9120-0db1a13b26fc admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.767525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dac89-d63a-4b19-9120-0db1a13b26fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:43.773373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dac89-d63a-4b19-9120-0db1a13b26fc admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:43.797409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 825/1631] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:43.797409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7b67f-99fa-4f4e-b7c9-625b5e1af19f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.797409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7b67f-99fa-4f4e-b7c9-625b5e1af19f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.797409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7b67f-99fa-4f4e-b7c9-625b5e1af19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.860001 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-e7b7b67f-99fa-4f4e-b7c9-625b5e1af19f None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:43.861597 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e7b7b67f-99fa-4f4e-b7c9-625b5e1af19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:43.877532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183801-5592-4fc7-9c3f-f320fc972681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:43.879578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183801-5592-4fc7-9c3f-f320fc972681 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:43.892162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 807/1632] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:43.893014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183801-5592-4fc7-9c3f-f320fc972681 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:43.909306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183801-5592-4fc7-9c3f-f320fc972681 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:43.916503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19046b-4e1e-46f8-b0f2-34f4c6c542bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:43.917670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19046b-4e1e-46f8-b0f2-34f4c6c542bf admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:43.917975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19046b-4e1e-46f8-b0f2-34f4c6c542bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:43.919240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19046b-4e1e-46f8-b0f2-34f4c6c542bf admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:43.920021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19046b-4e1e-46f8-b0f2-34f4c6c542bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:43.933610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19046b-4e1e-46f8-b0f2-34f4c6c542bf admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:43.951761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 808/1633] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:43.953253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19046b-4e1e-46f8-b0f2-34f4c6c542bf admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:43.978636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 826/1634] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:51:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:43.984212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7b67f-99fa-4f4e-b7c9-625b5e1af19f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:43.994117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19046b-4e1e-46f8-b0f2-34f4c6c542bf admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:44.005511 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff8309-6b12-4a8c-ae7e-7910ebab3087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:44.007987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7b67f-99fa-4f4e-b7c9-625b5e1af19f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:44.009308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff8309-6b12-4a8c-ae7e-7910ebab3087 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:44.009600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff8309-6b12-4a8c-ae7e-7910ebab3087 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:44.009877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff8309-6b12-4a8c-ae7e-7910ebab3087 admin admin] PATH_INFO: `/v3/projects/aa196fc5541548988f15c21fa3927a79/users/e46673698041406194526fac82951b91/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:44.025355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b1705-1a9a-4137-821b-6266b6c1bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:44.027473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b1705-1a9a-4137-821b-6266b6c1bed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:44.028888 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b1705-1a9a-4137-821b-6266b6c1bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:44.030158 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b1705-1a9a-4137-821b-6266b6c1bed8 admin admin] PATH_INFO: `/v3/projects/20dfa666055748de98edfcdb7b46a4c3/users/5223855cf08a49fa8184091d1d1b98f3/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:44.032321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff8309-6b12-4a8c-ae7e-7910ebab3087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa196fc5541548988f15c21fa3927a79, user_id=e46673698041406194526fac82951b91, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:44.035541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff8309-6b12-4a8c-ae7e-7910ebab3087 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:44.040185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b1705-1a9a-4137-821b-6266b6c1bed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20dfa666055748de98edfcdb7b46a4c3, user_id=5223855cf08a49fa8184091d1d1b98f3, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:44.048306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b1705-1a9a-4137-821b-6266b6c1bed8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:44.065276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 827/1635] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:43 2022] PUT /identity/v3/projects/20dfa666055748de98edfcdb7b46a4c3/users/5223855cf08a49fa8184091d1d1b98f3/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:44.079239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2c3cb-2f92-4786-9401-cbe7b2f361a0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:44.079471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2c3cb-2f92-4786-9401-cbe7b2f361a0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:44.079814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2c3cb-2f92-4786-9401-cbe7b2f361a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:44.152093 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-97d2c3cb-2f92-4786-9401-cbe7b2f361a0 None None] MFA Rules not processed for user `5223855cf08a49fa8184091d1d1b98f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:44.154405 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-97d2c3cb-2f92-4786-9401-cbe7b2f361a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:44.171522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 809/1636] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:43 2022] PUT /identity/v3/projects/aa196fc5541548988f15c21fa3927a79/users/e46673698041406194526fac82951b91/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:44.176444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff8309-6b12-4a8c-ae7e-7910ebab3087 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:44.226102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:44.284456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:44.340361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 828/1637] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:44 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:51:44.347643 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff8309-6b12-4a8c-ae7e-7910ebab3087 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:44.355634 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3690-7429-4a97-a049-70c933ef5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:44.356654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3690-7429-4a97-a049-70c933ef5f2c admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:44.356940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3690-7429-4a97-a049-70c933ef5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:44.357222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3690-7429-4a97-a049-70c933ef5f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:44.358011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac3690-7429-4a97-a049-70c933ef5f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:44.359786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac3690-7429-4a97-a049-70c933ef5f2c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:44.375291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 810/1638] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:51:44.381223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2c3cb-2f92-4786-9401-cbe7b2f361a0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:44.486495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2c3cb-2f92-4786-9401-cbe7b2f361a0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:44.492797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d6b25-6350-498c-b8ba-70886a6be34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:44.494659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d6b25-6350-498c-b8ba-70886a6be34d admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:44.494659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d6b25-6350-498c-b8ba-70886a6be34d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:44.495071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d6b25-6350-498c-b8ba-70886a6be34d admin admin] PATH_INFO: `/v3/projects/aa196fc5541548988f15c21fa3927a79/users/e46673698041406194526fac82951b91/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:44.497898 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d6b25-6350-498c-b8ba-70886a6be34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa196fc5541548988f15c21fa3927a79, user_id=e46673698041406194526fac82951b91, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:44.501585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d6b25-6350-498c-b8ba-70886a6be34d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:44.529231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db93200-d70d-4259-99c7-88f7547afa2b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:44.529507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db93200-d70d-4259-99c7-88f7547afa2b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:44.529761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 829/1639] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:44 2022] PUT /identity/v3/projects/aa196fc5541548988f15c21fa3927a79/users/e46673698041406194526fac82951b91/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:44.529901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db93200-d70d-4259-99c7-88f7547afa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:44.595925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-4db93200-d70d-4259-99c7-88f7547afa2b None None] MFA Rules not processed for user `e46673698041406194526fac82951b91`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:44.598483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4db93200-d70d-4259-99c7-88f7547afa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:44.679409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d6b25-6350-498c-b8ba-70886a6be34d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:44.727468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 811/1640] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:44 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:51:44.776258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d6b25-6350-498c-b8ba-70886a6be34d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:44.782179 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8915c-6424-4c67-be92-7332f21c780b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:44.783239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8915c-6424-4c67-be92-7332f21c780b service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:44.783693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8915c-6424-4c67-be92-7332f21c780b service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:44.784373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8915c-6424-4c67-be92-7332f21c780b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:44.897902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8915c-6424-4c67-be92-7332f21c780b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:44.900810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8915c-6424-4c67-be92-7332f21c780b service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:44.914261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 830/1641] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:51:45.685150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db93200-d70d-4259-99c7-88f7547afa2b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:45.702169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db93200-d70d-4259-99c7-88f7547afa2b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:45.709074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34aedb7-54ca-4227-ba70-2adf311fe440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:45.710877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aedb7-54ca-4227-ba70-2adf311fe440 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:45.724009 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aedb7-54ca-4227-ba70-2adf311fe440 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:45.724462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aedb7-54ca-4227-ba70-2adf311fe440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:45.862250 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34aedb7-54ca-4227-ba70-2adf311fe440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:45.865918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34aedb7-54ca-4227-ba70-2adf311fe440 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:45.892062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 812/1642] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:45 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:46.019450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8915c-6424-4c67-be92-7332f21c780b service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:46.045082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8915c-6424-4c67-be92-7332f21c780b service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:46.058602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9bebf-8e16-4683-9b32-3ed994400f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:46.060879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9bebf-8e16-4683-9b32-3ed994400f88 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:46.061128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9bebf-8e16-4683-9b32-3ed994400f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:46.062513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9bebf-8e16-4683-9b32-3ed994400f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:46.077707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9bebf-8e16-4683-9b32-3ed994400f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:46.079182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9bebf-8e16-4683-9b32-3ed994400f88 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:46.094814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 831/1643] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:46 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:46.933122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34aedb7-54ca-4227-ba70-2adf311fe440 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:46.933122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34aedb7-54ca-4227-ba70-2adf311fe440 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:46.933122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11026702-ebdc-41e6-9e62-fbf6d2144d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:46.933122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11026702-ebdc-41e6-9e62-fbf6d2144d35 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:46.937379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11026702-ebdc-41e6-9e62-fbf6d2144d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:46.937379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11026702-ebdc-41e6-9e62-fbf6d2144d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:46.937379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:46.937379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11026702-ebdc-41e6-9e62-fbf6d2144d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:46.937379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11026702-ebdc-41e6-9e62-fbf6d2144d35 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:46.937379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 813/1644] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:47.448109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9bebf-8e16-4683-9b32-3ed994400f88 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:47.464442 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9bebf-8e16-4683-9b32-3ed994400f88 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:47.473090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d7101-fd55-49cb-baa7-5dcb734e9041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:47.473864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d7101-fd55-49cb-baa7-5dcb734e9041 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:47.474311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d7101-fd55-49cb-baa7-5dcb734e9041 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:47.474835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d7101-fd55-49cb-baa7-5dcb734e9041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:47.485790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:47.608316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d7101-fd55-49cb-baa7-5dcb734e9041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:47.610376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d7101-fd55-49cb-baa7-5dcb734e9041 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:47.648351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 832/1645] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:52.956062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91785f-6867-48dd-b9a5-fb4ea1aef464 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:52.956625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91785f-6867-48dd-b9a5-fb4ea1aef464 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:52.956625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91785f-6867-48dd-b9a5-fb4ea1aef464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:52.994642 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9f91785f-6867-48dd-b9a5-fb4ea1aef464 None None] MFA Rules not processed for user `01bb3df8b4b649388d1a0f6c24e18f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:52.995914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9f91785f-6867-48dd-b9a5-fb4ea1aef464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:53.076943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 814/1646] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:53.094289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d7101-fd55-49cb-baa7-5dcb734e9041 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:53.121361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d7101-fd55-49cb-baa7-5dcb734e9041 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:53.150037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c2ccc-d58e-4f54-a438-ff76bd486039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:53.157522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c2ccc-d58e-4f54-a438-ff76bd486039 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:53.157522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c2ccc-d58e-4f54-a438-ff76bd486039 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:53.157522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c2ccc-d58e-4f54-a438-ff76bd486039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:53.191935 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c2ccc-d58e-4f54-a438-ff76bd486039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:53.193843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c2ccc-d58e-4f54-a438-ff76bd486039 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:53.208892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 833/1647] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:53.729882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91785f-6867-48dd-b9a5-fb4ea1aef464 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:53.839733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91785f-6867-48dd-b9a5-fb4ea1aef464 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:53.846326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:53.848902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:53.848902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:53.849220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] PATH_INFO: `/v3/users/5a6152b8f4cd472a983a5e87eab11391` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:53.851528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6152b8f4cd472a983a5e87eab11391)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:53.854357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:53.881475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423acc12-4b51-4191-b617-279863e48def None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:53.881847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423acc12-4b51-4191-b617-279863e48def None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:53.882635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423acc12-4b51-4191-b617-279863e48def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:53.920950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-423acc12-4b51-4191-b617-279863e48def None None] MFA Rules not processed for user `b0eb46b0aeeb46fe8dcdb02f29ae4013`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:53.922175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-423acc12-4b51-4191-b617-279863e48def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:54.041111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 834/1648] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:51:54.063584 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423acc12-4b51-4191-b617-279863e48def None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:54.087953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423acc12-4b51-4191-b617-279863e48def None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:54.104303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39110d5-e51d-4920-9da1-e58bac82a73e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:54.105148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39110d5-e51d-4920-9da1-e58bac82a73e service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:54.105590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39110d5-e51d-4920-9da1-e58bac82a73e service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:54.108110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39110d5-e51d-4920-9da1-e58bac82a73e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:54.118215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39110d5-e51d-4920-9da1-e58bac82a73e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:54.120391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39110d5-e51d-4920-9da1-e58bac82a73e service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:54.143750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 835/1649] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:54.174814 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6152b8f4cd472a983a5e87eab11391'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:51:54.190713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6152b8f4cd472a983a5e87eab11391'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:51:54.283229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6152b8f4cd472a983a5e87eab11391'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:51:54.283986 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6152b8f4cd472a983a5e87eab11391'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:51:54.284616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6152b8f4cd472a983a5e87eab11391'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:51:54.286937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:54.336948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 815/1650] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:51:53 2022] DELETE /identity/v3/users/5a6152b8f4cd472a983a5e87eab11391 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:54.339504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d73316-7e74-4eb7-853e-53984952fe1d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:54.339787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d73316-7e74-4eb7-853e-53984952fe1d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:54.340257 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d73316-7e74-4eb7-853e-53984952fe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:54.396378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-95d73316-7e74-4eb7-853e-53984952fe1d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:54.398211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-95d73316-7e74-4eb7-853e-53984952fe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:54.568233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 836/1651] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:54.579305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:54.582992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:54.707083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edf261-5914-4cb7-af96-6d729337cea9 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:54.714667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f6cb3-2c53-479a-9810-1a32ac494caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:54.714667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f6cb3-2c53-479a-9810-1a32ac494caa service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:54.714667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f6cb3-2c53-479a-9810-1a32ac494caa service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:54.714975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f6cb3-2c53-479a-9810-1a32ac494caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:54.732702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f6cb3-2c53-479a-9810-1a32ac494caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:54.734363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f6cb3-2c53-479a-9810-1a32ac494caa service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:54.767679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 816/1652] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:55.407685 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9fc11-14b4-4757-b07b-86e03bf9b1eb None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:55.408154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9fc11-14b4-4757-b07b-86e03bf9b1eb None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:55.408315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9fc11-14b4-4757-b07b-86e03bf9b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:55.455365 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:55.458842 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-21b9fc11-14b4-4757-b07b-86e03bf9b1eb None None] MFA Rules not processed for user `72e4c92b149c4dffbdeba414d8803bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:55.460764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-21b9fc11-14b4-4757-b07b-86e03bf9b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:55.618489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 837/1653] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:55.637945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df808-d138-474d-b4b5-06a59ac7c456 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:55.638424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df808-d138-474d-b4b5-06a59ac7c456 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:55.642218 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df808-d138-474d-b4b5-06a59ac7c456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:55.697670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f40df808-d138-474d-b4b5-06a59ac7c456 None None] MFA Rules not processed for user `72e4c92b149c4dffbdeba414d8803bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:55.699233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f40df808-d138-474d-b4b5-06a59ac7c456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:55.715856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 817/1654] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:55.731395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9fc11-14b4-4757-b07b-86e03bf9b1eb None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:55.734780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-21b9fc11-14b4-4757-b07b-86e03bf9b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:55.938608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9fc11-14b4-4757-b07b-86e03bf9b1eb None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:55.949649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e567654-ead9-4921-a009-5afda1ec4ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:55.950422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567654-ead9-4921-a009-5afda1ec4ef0 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:55.951225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567654-ead9-4921-a009-5afda1ec4ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:55.951225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567654-ead9-4921-a009-5afda1ec4ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:55.966370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e567654-ead9-4921-a009-5afda1ec4ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:55.968937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e567654-ead9-4921-a009-5afda1ec4ef0 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:55.994495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 838/1655] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:56.296884 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df808-d138-474d-b4b5-06a59ac7c456 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:56.298981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f40df808-d138-474d-b4b5-06a59ac7c456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:56.335657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df808-d138-474d-b4b5-06a59ac7c456 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:56.352801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:56.353846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:56.357788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:56.357788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] PATH_INFO: `/v3/projects/2bfcf91b0c2b42ccab1c652c7b7fd5ac` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:56.363006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bfcf91b0c2b42ccab1c652c7b7fd5ac)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:56.364386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: WARNING py.warnings [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:51:56.364386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: warnings.warn(msg) Jun 17 08:51:56.364386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: Jun 17 08:51:56.366382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:56.640692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bfcf91b0c2b42ccab1c652c7b7fd5ac', 'request_id': 'req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:51:56.724487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bfcf91b0c2b42ccab1c652c7b7fd5ac', 'request_id': 'req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:51:56.769775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bfcf91b0c2b42ccab1c652c7b7fd5ac', 'request_id': 'req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:51:56.888853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64994b9-0d7c-49c6-ab3b-a78c79269d28 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:56.889674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64994b9-0d7c-49c6-ab3b-a78c79269d28 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:56.890294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64994b9-0d7c-49c6-ab3b-a78c79269d28 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:56.892672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 839/1656] 10.222.0.78 () {54 vars in 912 bytes} [Fri Jun 17 08:51:56 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:51:56.901218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1e52-3530-4190-9062-6833e8bef7c3 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:56.901766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1e52-3530-4190-9062-6833e8bef7c3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:56.902182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e1e52-3530-4190-9062-6833e8bef7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:56.915787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] The token cache is being invalidate because project 2bfcf91b0c2b42ccab1c652c7b7fd5ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:51:56.916206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:51:56.917698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-14f408d9-b88d-4dd7-b2e2-2de65e5e46e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:51:56.923060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 818/1657] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:51:56 2022] DELETE /identity/v3/projects/2bfcf91b0c2b42ccab1c652c7b7fd5ac => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:56.932714 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc68aa-fd48-45db-974c-1d9ebb21b6bc None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:56.935818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc68aa-fd48-45db-974c-1d9ebb21b6bc None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:56.937251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc68aa-fd48-45db-974c-1d9ebb21b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:57.011527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-6bcc68aa-fd48-45db-974c-1d9ebb21b6bc None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:57.014776 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-6bcc68aa-fd48-45db-974c-1d9ebb21b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:57.062938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-321e1e52-3530-4190-9062-6833e8bef7c3 None None] MFA Rules not processed for user `024e0e53cfdb42e88dfdfde7a79e8c75`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:57.065685 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-321e1e52-3530-4190-9062-6833e8bef7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:57.182627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 819/1658] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:57.190731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e722-9236-41d8-b14f-cef5764c9943 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:57.191596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e722-9236-41d8-b14f-cef5764c9943 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:57.192053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e722-9236-41d8-b14f-cef5764c9943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:57.212201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:57.230407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 840/1659] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:51:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:51:57.254244 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-0362e722-9236-41d8-b14f-cef5764c9943 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:57.256180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0362e722-9236-41d8-b14f-cef5764c9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:57.277945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1e52-3530-4190-9062-6833e8bef7c3 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:57.278871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 820/1660] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:57.283208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362e722-9236-41d8-b14f-cef5764c9943 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:57.283614 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-321e1e52-3530-4190-9062-6833e8bef7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:57.301099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e1e52-3530-4190-9062-6833e8bef7c3 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:57.311234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362e722-9236-41d8-b14f-cef5764c9943 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:57.314811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df9e47-b696-4a3a-b19b-70c86b832898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:57.315716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9e47-b696-4a3a-b19b-70c86b832898 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:57.316327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9e47-b696-4a3a-b19b-70c86b832898 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:57.319897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9e47-b696-4a3a-b19b-70c86b832898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:57.327665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf511c4-2c94-4794-9305-0e14284e73d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:57.345256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf511c4-2c94-4794-9305-0e14284e73d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:57.345256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf511c4-2c94-4794-9305-0e14284e73d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:57.345256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf511c4-2c94-4794-9305-0e14284e73d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:57.345256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf511c4-2c94-4794-9305-0e14284e73d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:51:57.345256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf511c4-2c94-4794-9305-0e14284e73d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:57.345256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf511c4-2c94-4794-9305-0e14284e73d1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:57.351771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df9e47-b696-4a3a-b19b-70c86b832898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:57.353673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df9e47-b696-4a3a-b19b-70c86b832898 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:57.363866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 841/1661] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:51:57.375587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df9e47-b696-4a3a-b19b-70c86b832898 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:57.375836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 821/1662] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:51:57.418919 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df9e47-b696-4a3a-b19b-70c86b832898 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:57.436106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349a5f-3bab-400a-812f-41e578dcb27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:57.436951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349a5f-3bab-400a-812f-41e578dcb27f admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:57.437328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349a5f-3bab-400a-812f-41e578dcb27f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:57.437700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f349a5f-3bab-400a-812f-41e578dcb27f admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:57.441310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f349a5f-3bab-400a-812f-41e578dcb27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:57.443281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f349a5f-3bab-400a-812f-41e578dcb27f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:57.452329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:57.635326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 842/1663] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:51:57 2022] POST /identity/v3/projects => generated 405 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:57.638351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf511c4-2c94-4794-9305-0e14284e73d1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:57.652257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf511c4-2c94-4794-9305-0e14284e73d1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:57.789405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a504ac0-2162-49b4-a459-7ff6431e8408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:57.790636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a504ac0-2162-49b4-a459-7ff6431e8408 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:57.805195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a504ac0-2162-49b4-a459-7ff6431e8408 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:57.805761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a504ac0-2162-49b4-a459-7ff6431e8408 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:57.806562 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a504ac0-2162-49b4-a459-7ff6431e8408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:57.811371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a504ac0-2162-49b4-a459-7ff6431e8408 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:57.939802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 822/1664] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:51:57 2022] POST /identity/v3/users => generated 303 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:51:57.948117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349a5f-3bab-400a-812f-41e578dcb27f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:57.966359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f349a5f-3bab-400a-812f-41e578dcb27f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:57.980022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fceb97-3290-452e-8cf2-121bc68e1b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:57.982060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fceb97-3290-452e-8cf2-121bc68e1b81 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:57.982370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fceb97-3290-452e-8cf2-121bc68e1b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:57.982653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fceb97-3290-452e-8cf2-121bc68e1b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:57.986735 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fceb97-3290-452e-8cf2-121bc68e1b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:57.992556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fceb97-3290-452e-8cf2-121bc68e1b81 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:58.017299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 843/1665] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:58.020216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a504ac0-2162-49b4-a459-7ff6431e8408 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:58.041484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a504ac0-2162-49b4-a459-7ff6431e8408 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:58.064038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aa938-9792-43f4-bd05-e0ab2a004fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:58.065093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aa938-9792-43f4-bd05-e0ab2a004fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:58.068080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aa938-9792-43f4-bd05-e0ab2a004fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:58.068080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aa938-9792-43f4-bd05-e0ab2a004fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:58.068080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48aa938-9792-43f4-bd05-e0ab2a004fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:58.075555 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48aa938-9792-43f4-bd05-e0ab2a004fc5 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:58.099227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 823/1666] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:51:58.103710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fceb97-3290-452e-8cf2-121bc68e1b81 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:58.118159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fceb97-3290-452e-8cf2-121bc68e1b81 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:58.135606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e76745-438f-4e5c-803c-3bab821dbd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:58.136818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e76745-438f-4e5c-803c-3bab821dbd9d admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:58.137469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e76745-438f-4e5c-803c-3bab821dbd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:58.138043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e76745-438f-4e5c-803c-3bab821dbd9d admin admin] PATH_INFO: `/v3/projects/71724692ece948e8be8b11277eead101/users/feabfb90a3b34ed1918ec529d2c46ee0/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:58.186886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e76745-438f-4e5c-803c-3bab821dbd9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71724692ece948e8be8b11277eead101, user_id=feabfb90a3b34ed1918ec529d2c46ee0, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:58.195639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e76745-438f-4e5c-803c-3bab821dbd9d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:58.331884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 844/1667] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:51:58 2022] PUT /identity/v3/projects/71724692ece948e8be8b11277eead101/users/feabfb90a3b34ed1918ec529d2c46ee0/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:51:58.333920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12146a8-b307-4a99-ae15-4ea107f8a2bf None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:58.334084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12146a8-b307-4a99-ae15-4ea107f8a2bf None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:58.334398 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12146a8-b307-4a99-ae15-4ea107f8a2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:58.363782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d12146a8-b307-4a99-ae15-4ea107f8a2bf None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:58.365061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d12146a8-b307-4a99-ae15-4ea107f8a2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:58.506053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 824/1668] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:58.515720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e76745-438f-4e5c-803c-3bab821dbd9d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:58.517595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-81e76745-438f-4e5c-803c-3bab821dbd9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:58.698500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e76745-438f-4e5c-803c-3bab821dbd9d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:58.710372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0306c61-67f5-45e1-8be4-b514fe0140e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:58.711478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0306c61-67f5-45e1-8be4-b514fe0140e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:58.711880 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0306c61-67f5-45e1-8be4-b514fe0140e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:58.712286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0306c61-67f5-45e1-8be4-b514fe0140e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:58.739003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0306c61-67f5-45e1-8be4-b514fe0140e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:58.740660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0306c61-67f5-45e1-8be4-b514fe0140e7 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:58.771735 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 845/1669] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:51:58.840390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e422ff-8174-465a-8d31-ed39a734ef1e None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:58.840830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e422ff-8174-465a-8d31-ed39a734ef1e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:58.841353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e422ff-8174-465a-8d31-ed39a734ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:58.889171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d4e422ff-8174-465a-8d31-ed39a734ef1e None None] MFA Rules not processed for user `01bb3df8b4b649388d1a0f6c24e18f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:58.890582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d4e422ff-8174-465a-8d31-ed39a734ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:59.106011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 825/1670] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:51:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:59.297446 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0309b96-86ef-4327-abee-8cf0f7a26ac2 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:59.298411 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0309b96-86ef-4327-abee-8cf0f7a26ac2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:59.298897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0309b96-86ef-4327-abee-8cf0f7a26ac2 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:59.305441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 846/1671] 10.222.0.78 () {54 vars in 960 bytes} [Fri Jun 17 08:51:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:51:59.307911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa24014-5a94-4b84-868e-1c0efc1a8997 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:59.308210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa24014-5a94-4b84-868e-1c0efc1a8997 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:59.308541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa24014-5a94-4b84-868e-1c0efc1a8997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:59.354131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-4fa24014-5a94-4b84-868e-1c0efc1a8997 None None] MFA Rules not processed for user `f79f43c31f5346d5b1e6ae6ff8c511a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:51:59.358750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4fa24014-5a94-4b84-868e-1c0efc1a8997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:59.779999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 826/1672] 10.222.0.78 () {58 vars in 1057 bytes} [Fri Jun 17 08:51:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:51:59.779999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:51:59.788984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0309b96-86ef-4327-abee-8cf0f7a26ac2 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:51:59.788984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0309b96-86ef-4327-abee-8cf0f7a26ac2 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:51:59.788984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ae5e6-1e23-4294-8219-b87e2323b78f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:51:59.788984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae5e6-1e23-4294-8219-b87e2323b78f service placement] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:51:59.791166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae5e6-1e23-4294-8219-b87e2323b78f service placement] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:51:59.791166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ae5e6-1e23-4294-8219-b87e2323b78f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:51:59.791166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c74ae5e6-1e23-4294-8219-b87e2323b78f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:51:59.791166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ae5e6-1e23-4294-8219-b87e2323b78f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:51:59.791166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ae5e6-1e23-4294-8219-b87e2323b78f service placement] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:51:59.791166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 847/1673] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:51:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:00.682506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4398719-afcb-49e9-a40a-ad2c003cc023 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:00.683069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4398719-afcb-49e9-a40a-ad2c003cc023 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:00.683069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4398719-afcb-49e9-a40a-ad2c003cc023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:00.721528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b4398719-afcb-49e9-a40a-ad2c003cc023 None None] MFA Rules not processed for user `b0eb46b0aeeb46fe8dcdb02f29ae4013`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:00.722810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b4398719-afcb-49e9-a40a-ad2c003cc023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:00.880622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 827/1674] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:01.333696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b498-dbc8-4e35-8511-d66e0ecfdf98 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:01.333696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b498-dbc8-4e35-8511-d66e0ecfdf98 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:01.333696 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b498-dbc8-4e35-8511-d66e0ecfdf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:01.424140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-6291b498-dbc8-4e35-8511-d66e0ecfdf98 None None] MFA Rules not processed for user `feabfb90a3b34ed1918ec529d2c46ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:01.428769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6291b498-dbc8-4e35-8511-d66e0ecfdf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:01.464289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4398719-afcb-49e9-a40a-ad2c003cc023 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:01.466917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b4398719-afcb-49e9-a40a-ad2c003cc023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:01.526952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4398719-afcb-49e9-a40a-ad2c003cc023 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:01.533645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:01.533755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:01.533955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:01.534403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] PATH_INFO: `/v3/users/65143f81d67b4a33b50540d0d6da13fa` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:01.537472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65143f81d67b4a33b50540d0d6da13fa)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:01.542335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:01.622013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 848/1675] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:01.624760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfcd8-1c2d-4e06-a665-c958f7f42711 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:01.626011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfcd8-1c2d-4e06-a665-c958f7f42711 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:01.626372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bfcd8-1c2d-4e06-a665-c958f7f42711 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:01.628287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 849/1676] 10.222.0.78 () {54 vars in 912 bytes} [Fri Jun 17 08:52:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:52:01.629852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bfcd8-1c2d-4e06-a665-c958f7f42711 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:01.650710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bfcd8-1c2d-4e06-a665-c958f7f42711 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:01.665541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27460b35-0c93-4e7e-9bc6-749de30e1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:01.665541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460b35-0c93-4e7e-9bc6-749de30e1adc admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:01.665541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460b35-0c93-4e7e-9bc6-749de30e1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:01.665541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460b35-0c93-4e7e-9bc6-749de30e1adc admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:01.665960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27460b35-0c93-4e7e-9bc6-749de30e1adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:01.665960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27460b35-0c93-4e7e-9bc6-749de30e1adc admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:01.782813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 850/1677] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:01 2022] POST /identity/v3/projects => generated 403 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:01.782813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7b5e-6b3b-4456-a3c1-0f60784d075d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:01.782813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7b5e-6b3b-4456-a3c1-0f60784d075d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:01.783333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7b5e-6b3b-4456-a3c1-0f60784d075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:01.806107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:01.806898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65143f81d67b4a33b50540d0d6da13fa'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:01.814059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-582e7b5e-6b3b-4456-a3c1-0f60784d075d None None] MFA Rules not processed for user `024e0e53cfdb42e88dfdfde7a79e8c75`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:01.817090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-582e7b5e-6b3b-4456-a3c1-0f60784d075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:01.825167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65143f81d67b4a33b50540d0d6da13fa'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:01.893135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 851/1678] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:52:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:01.894282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7b5e-6b3b-4456-a3c1-0f60784d075d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:01.915564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65143f81d67b4a33b50540d0d6da13fa'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:01.916672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65143f81d67b4a33b50540d0d6da13fa'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:01.922902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65143f81d67b4a33b50540d0d6da13fa'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:01.972008 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 828/1679] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:01 2022] DELETE /identity/v3/users/65143f81d67b4a33b50540d0d6da13fa => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:01.973311 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:01.977717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:02.020415 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:02.097966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7b5e-6b3b-4456-a3c1-0f60784d075d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:02.132182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bf855-2c1b-453d-99e8-0ca2146c3ca4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:02.142417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442ec5f-62c3-4b9a-a8a2-fd14b676efb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:02.143093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442ec5f-62c3-4b9a-a8a2-fd14b676efb1 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:02.143399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442ec5f-62c3-4b9a-a8a2-fd14b676efb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:02.144181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442ec5f-62c3-4b9a-a8a2-fd14b676efb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:02.146406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0442ec5f-62c3-4b9a-a8a2-fd14b676efb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:02.173548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442ec5f-62c3-4b9a-a8a2-fd14b676efb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:02.175933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442ec5f-62c3-4b9a-a8a2-fd14b676efb1 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:02.197883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 829/1680] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:02.199480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d3d9-b68f-4490-890c-9750ac45875f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:02.199781 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d3d9-b68f-4490-890c-9750ac45875f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:02.204267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d3d9-b68f-4490-890c-9750ac45875f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:02.241521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff7e1-b405-4db8-bdfd-d50370c2af76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:02.242546 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff7e1-b405-4db8-bdfd-d50370c2af76 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:02.245977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff7e1-b405-4db8-bdfd-d50370c2af76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:02.245977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff7e1-b405-4db8-bdfd-d50370c2af76 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:02.245977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ff7e1-b405-4db8-bdfd-d50370c2af76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:02.246221 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-6320d3d9-b68f-4490-890c-9750ac45875f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:02.246318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ff7e1-b405-4db8-bdfd-d50370c2af76 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:02.246384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-6320d3d9-b68f-4490-890c-9750ac45875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:02.265822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 830/1681] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:02.278785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d3d9-b68f-4490-890c-9750ac45875f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:02.283470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-6320d3d9-b68f-4490-890c-9750ac45875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:02.293863 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d3d9-b68f-4490-890c-9750ac45875f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:02.298495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528032f-3d6e-44a6-b78d-4525c26b7650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:02.299204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528032f-3d6e-44a6-b78d-4525c26b7650 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:02.299532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528032f-3d6e-44a6-b78d-4525c26b7650 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:02.299982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528032f-3d6e-44a6-b78d-4525c26b7650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:02.313000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528032f-3d6e-44a6-b78d-4525c26b7650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:02.314599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528032f-3d6e-44a6-b78d-4525c26b7650 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:02.349171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 831/1682] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:02.406835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 852/1683] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:01 2022] POST /identity/v3/users => generated 308 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:02.409699 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528032f-3d6e-44a6-b78d-4525c26b7650 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:02.411702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a528032f-3d6e-44a6-b78d-4525c26b7650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:02.443339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528032f-3d6e-44a6-b78d-4525c26b7650 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:02.460928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d1ee-6824-4db2-b73f-e4643c02c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:02.461714 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d1ee-6824-4db2-b73f-e4643c02c88c admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:02.462453 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d1ee-6824-4db2-b73f-e4643c02c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:02.462807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d1ee-6824-4db2-b73f-e4643c02c88c admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:02.464074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40d1ee-6824-4db2-b73f-e4643c02c88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:02.471634 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40d1ee-6824-4db2-b73f-e4643c02c88c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:02.497424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 832/1684] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:02.498465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff7e1-b405-4db8-bdfd-d50370c2af76 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:02.511627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff7e1-b405-4db8-bdfd-d50370c2af76 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:02.522015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abb452-27f0-4df1-bce6-e9b8a8bf870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:02.525294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abb452-27f0-4df1-bce6-e9b8a8bf870b admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:02.525856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abb452-27f0-4df1-bce6-e9b8a8bf870b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:02.526354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abb452-27f0-4df1-bce6-e9b8a8bf870b admin admin] PATH_INFO: `/v3/projects/2394b46b1dd44fef96398c1f78ac12a4/users/0305f1f0b7c64f25a078156c8be1457e/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:02.544383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abb452-27f0-4df1-bce6-e9b8a8bf870b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2394b46b1dd44fef96398c1f78ac12a4, user_id=0305f1f0b7c64f25a078156c8be1457e, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:02.547757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abb452-27f0-4df1-bce6-e9b8a8bf870b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:02.689332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 853/1685] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:02 2022] PUT /identity/v3/projects/2394b46b1dd44fef96398c1f78ac12a4/users/0305f1f0b7c64f25a078156c8be1457e/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:02.692946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d1ee-6824-4db2-b73f-e4643c02c88c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:02.733952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d1ee-6824-4db2-b73f-e4643c02c88c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:02.880749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3cdd3-98ff-495d-ad7b-e443d9c392c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:02.886407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3cdd3-98ff-495d-ad7b-e443d9c392c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:02.886407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3cdd3-98ff-495d-ad7b-e443d9c392c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:02.886407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3cdd3-98ff-495d-ad7b-e443d9c392c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:02.886407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3cdd3-98ff-495d-ad7b-e443d9c392c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:02.887119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3cdd3-98ff-495d-ad7b-e443d9c392c0 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:02.906854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abb452-27f0-4df1-bce6-e9b8a8bf870b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:02.917266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 833/1686] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:02.920161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abb452-27f0-4df1-bce6-e9b8a8bf870b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:02.927069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef75374-b794-4315-8ec6-5c359e0605f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:02.929348 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75374-b794-4315-8ec6-5c359e0605f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:02.929987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75374-b794-4315-8ec6-5c359e0605f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:02.930413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75374-b794-4315-8ec6-5c359e0605f5 admin admin] PATH_INFO: `/v3/projects/2394b46b1dd44fef96398c1f78ac12a4/users/0305f1f0b7c64f25a078156c8be1457e/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:02.933364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef75374-b794-4315-8ec6-5c359e0605f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2394b46b1dd44fef96398c1f78ac12a4, user_id=0305f1f0b7c64f25a078156c8be1457e, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:02.937918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef75374-b794-4315-8ec6-5c359e0605f5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:02.959489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 854/1687] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:02 2022] PUT /identity/v3/projects/2394b46b1dd44fef96398c1f78ac12a4/users/0305f1f0b7c64f25a078156c8be1457e/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:03.264644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3cdd3-98ff-495d-ad7b-e443d9c392c0 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:03.268569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c4d3cdd3-98ff-495d-ad7b-e443d9c392c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:03.290364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef75374-b794-4315-8ec6-5c359e0605f5 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:03.292757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9ef75374-b794-4315-8ec6-5c359e0605f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:03.337197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3cdd3-98ff-495d-ad7b-e443d9c392c0 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:03.533098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef75374-b794-4315-8ec6-5c359e0605f5 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:03.546076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:03.546996 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:03.547470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:03.547747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] PATH_INFO: `/v3/users/a1a1aadce7ca4b05b618e6a2cb0c95d2` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:03.552190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a1aadce7ca4b05b618e6a2cb0c95d2)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:03.553087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: WARNING py.warnings [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 17 08:52:03.553087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: warnings.warn(msg) Jun 17 08:52:03.553087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: Jun 17 08:52:03.554286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:03.569490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:03.570364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:03.570645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:03.571037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] PATH_INFO: `/v3/projects/e06c8d8aad664fd2a55e9e871bc9842a` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:03.572409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06c8d8aad664fd2a55e9e871bc9842a)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:03.574530 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:03.844035 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a1aadce7ca4b05b618e6a2cb0c95d2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:03.854012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06c8d8aad664fd2a55e9e871bc9842a', 'request_id': 'req-66257ac2-aae3-4474-a455-7f66e4f7a510'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:03.867215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06c8d8aad664fd2a55e9e871bc9842a', 'request_id': 'req-66257ac2-aae3-4474-a455-7f66e4f7a510'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:03.878852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a1aadce7ca4b05b618e6a2cb0c95d2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:03.885267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06c8d8aad664fd2a55e9e871bc9842a', 'request_id': 'req-66257ac2-aae3-4474-a455-7f66e4f7a510'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:03.999940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a1aadce7ca4b05b618e6a2cb0c95d2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:04.025508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a1aadce7ca4b05b618e6a2cb0c95d2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:04.026425 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-49250195-beee-40d9-9956-bdecf6ff4338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a1aadce7ca4b05b618e6a2cb0c95d2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:04.035492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 855/1688] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:03 2022] DELETE /identity/v3/users/a1a1aadce7ca4b05b618e6a2cb0c95d2 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:04.042529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a309e6-5147-4c00-aeb7-f272dec9c018 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:04.042894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a309e6-5147-4c00-aeb7-f272dec9c018 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:04.043419 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a309e6-5147-4c00-aeb7-f272dec9c018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:04.069920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-53a309e6-5147-4c00-aeb7-f272dec9c018 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:04.070795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-53a309e6-5147-4c00-aeb7-f272dec9c018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:04.096607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] The token cache is being invalidate because project e06c8d8aad664fd2a55e9e871bc9842a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:04.101455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:04.101455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:04.102409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 834/1689] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:03 2022] DELETE /identity/v3/projects/e06c8d8aad664fd2a55e9e871bc9842a => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:04.103217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:04.109917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:04.166953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 856/1690] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:04.168417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bfb82-38cc-454d-8d31-0ed1ec479da1 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:04.168783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bfb82-38cc-454d-8d31-0ed1ec479da1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:04.169126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bfb82-38cc-454d-8d31-0ed1ec479da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:04.190204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-4d3bfb82-38cc-454d-8d31-0ed1ec479da1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:04.191581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4d3bfb82-38cc-454d-8d31-0ed1ec479da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:04.196001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66257ac2-aae3-4474-a455-7f66e4f7a510 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:04.200238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 857/1691] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:04.200908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bfb82-38cc-454d-8d31-0ed1ec479da1 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:04.202184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4d3bfb82-38cc-454d-8d31-0ed1ec479da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:04.208617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:04.210027 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:04.210305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:04.210579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] PATH_INFO: `/v3/users/89d3453f12bf42d484519a88ac0e2984` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:04.212049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d3453f12bf42d484519a88ac0e2984)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:04.213960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:04.281464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bfb82-38cc-454d-8d31-0ed1ec479da1 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:04.286655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f84c7-fe2a-4064-97a0-9a14bd48897c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:04.287364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f84c7-fe2a-4064-97a0-9a14bd48897c service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:04.288619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f84c7-fe2a-4064-97a0-9a14bd48897c service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:04.288898 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f84c7-fe2a-4064-97a0-9a14bd48897c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:04.308489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f84c7-fe2a-4064-97a0-9a14bd48897c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:04.310063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f84c7-fe2a-4064-97a0-9a14bd48897c service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:04.320953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 858/1692] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:04.322469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86707770-d33a-4720-af04-884ba95695e1 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:04.322821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86707770-d33a-4720-af04-884ba95695e1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:04.323169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86707770-d33a-4720-af04-884ba95695e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:04.343980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-86707770-d33a-4720-af04-884ba95695e1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:04.345620 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-86707770-d33a-4720-af04-884ba95695e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:04.354699 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 859/1693] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:04.363811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86707770-d33a-4720-af04-884ba95695e1 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:04.376745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86707770-d33a-4720-af04-884ba95695e1 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:04.383402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097cf8-10ba-4d6a-8635-1b902ebb8822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:04.384139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097cf8-10ba-4d6a-8635-1b902ebb8822 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:04.384427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097cf8-10ba-4d6a-8635-1b902ebb8822 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:04.384711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097cf8-10ba-4d6a-8635-1b902ebb8822 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:04.385464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7097cf8-10ba-4d6a-8635-1b902ebb8822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:04.385770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7097cf8-10ba-4d6a-8635-1b902ebb8822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:04.387447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7097cf8-10ba-4d6a-8635-1b902ebb8822 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:04.404186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 860/1694] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:52:04.409598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097cf8-10ba-4d6a-8635-1b902ebb8822 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:04.418014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:04.427055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097cf8-10ba-4d6a-8635-1b902ebb8822 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:04.433857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2d1f5-7848-49c5-8480-84da39d5f747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:04.435030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2d1f5-7848-49c5-8480-84da39d5f747 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:04.435848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2d1f5-7848-49c5-8480-84da39d5f747 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:04.436432 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2d1f5-7848-49c5-8480-84da39d5f747 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:04.447228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2d1f5-7848-49c5-8480-84da39d5f747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:04.447228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2d1f5-7848-49c5-8480-84da39d5f747 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:04.499637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d3453f12bf42d484519a88ac0e2984'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:04.515270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d3453f12bf42d484519a88ac0e2984'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:04.611866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 861/1695] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:04 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:04.615986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2d1f5-7848-49c5-8480-84da39d5f747 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:04.646755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d3453f12bf42d484519a88ac0e2984'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:04.650010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d3453f12bf42d484519a88ac0e2984'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:04.653832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-32e95530-f6c9-4413-812a-0fce1ff83e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d3453f12bf42d484519a88ac0e2984'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:04.705342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2d1f5-7848-49c5-8480-84da39d5f747 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:04.711739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8f63f-53cd-4642-a579-1cde0c177a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:04.712447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8f63f-53cd-4642-a579-1cde0c177a7e admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:04.712739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8f63f-53cd-4642-a579-1cde0c177a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:04.713033 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8f63f-53cd-4642-a579-1cde0c177a7e admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:04.713733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8f63f-53cd-4642-a579-1cde0c177a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:04.715111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 835/1696] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:04 2022] DELETE /identity/v3/users/89d3453f12bf42d484519a88ac0e2984 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:04.715958 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8f63f-53cd-4642-a579-1cde0c177a7e admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:04.729526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6ef57-6dc4-4d1a-9ef2-a4096a77bfa1 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:04.730103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6ef57-6dc4-4d1a-9ef2-a4096a77bfa1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:04.730544 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6ef57-6dc4-4d1a-9ef2-a4096a77bfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:04.776470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-79f6ef57-6dc4-4d1a-9ef2-a4096a77bfa1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:04.777733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-79f6ef57-6dc4-4d1a-9ef2-a4096a77bfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:04.868211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 836/1697] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:04.890255 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 862/1698] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:04 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:04.891298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6ef57-6dc4-4d1a-9ef2-a4096a77bfa1 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:04.894367 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-79f6ef57-6dc4-4d1a-9ef2-a4096a77bfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:04.936756 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6ef57-6dc4-4d1a-9ef2-a4096a77bfa1 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:04.961697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54051098-25a1-46a5-b041-894892f432f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:04.963680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54051098-25a1-46a5-b041-894892f432f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:04.966974 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54051098-25a1-46a5-b041-894892f432f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:04.967489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54051098-25a1-46a5-b041-894892f432f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:04.968488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54051098-25a1-46a5-b041-894892f432f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:04.972912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54051098-25a1-46a5-b041-894892f432f9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:04.986513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8f63f-53cd-4642-a579-1cde0c177a7e admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:04.988903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d1c8f63f-53cd-4642-a579-1cde0c177a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:05.007828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 837/1699] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:05.011101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54051098-25a1-46a5-b041-894892f432f9 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:05.032601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54051098-25a1-46a5-b041-894892f432f9 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:05.040166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15078af-9ec0-415d-a935-655c888eca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:05.041515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15078af-9ec0-415d-a935-655c888eca27 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:05.042004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15078af-9ec0-415d-a935-655c888eca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:05.049143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15078af-9ec0-415d-a935-655c888eca27 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:05.049143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15078af-9ec0-415d-a935-655c888eca27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:05.049143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15078af-9ec0-415d-a935-655c888eca27 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:05.065699 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 838/1700] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:05.070235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15078af-9ec0-415d-a935-655c888eca27 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:05.095479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15078af-9ec0-415d-a935-655c888eca27 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:05.101504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b571fa-e0b6-4200-9a7b-80118578e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:05.105388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b571fa-e0b6-4200-9a7b-80118578e1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:05.105388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b571fa-e0b6-4200-9a7b-80118578e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:05.105837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b571fa-e0b6-4200-9a7b-80118578e1cb admin admin] PATH_INFO: `/v3/projects/b131c0701a0843f193e9a876b03a730c/users/5d745e4dd1b742f7a7e1255bb4ffd664/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:05.140024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b571fa-e0b6-4200-9a7b-80118578e1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b131c0701a0843f193e9a876b03a730c, user_id=5d745e4dd1b742f7a7e1255bb4ffd664, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:05.143912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b571fa-e0b6-4200-9a7b-80118578e1cb admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:05.146101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8f63f-53cd-4642-a579-1cde0c177a7e admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:05.229758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29a203-d006-4702-9c56-78c057ad3eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:05.230487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29a203-d006-4702-9c56-78c057ad3eeb service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:05.230824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29a203-d006-4702-9c56-78c057ad3eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:05.231107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29a203-d006-4702-9c56-78c057ad3eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:05.250295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29a203-d006-4702-9c56-78c057ad3eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:05.251778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29a203-d006-4702-9c56-78c057ad3eeb service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:05.267200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 839/1701] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:05 2022] PUT /identity/v3/projects/b131c0701a0843f193e9a876b03a730c/users/5d745e4dd1b742f7a7e1255bb4ffd664/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:05.279690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b707b9-653e-4c90-86f9-dd87fbefcd04 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:05.280309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b707b9-653e-4c90-86f9-dd87fbefcd04 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:05.281106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b707b9-653e-4c90-86f9-dd87fbefcd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:05.299001 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 863/1702] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:05.325526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-04b707b9-653e-4c90-86f9-dd87fbefcd04 None None] MFA Rules not processed for user `5d745e4dd1b742f7a7e1255bb4ffd664`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:05.326227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-04b707b9-653e-4c90-86f9-dd87fbefcd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:05.427442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 840/1703] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:05.441905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29a203-d006-4702-9c56-78c057ad3eeb service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:05.443757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1d29a203-d006-4702-9c56-78c057ad3eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:05.499618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b707b9-653e-4c90-86f9-dd87fbefcd04 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:05.500902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-04b707b9-653e-4c90-86f9-dd87fbefcd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:05.595510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b707b9-653e-4c90-86f9-dd87fbefcd04 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:05.601046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:05.602513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:05.602793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:05.603065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] PATH_INFO: `/v3/users/648670aa855a4f7185c621b7006774da` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:05.605049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648670aa855a4f7185c621b7006774da)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:05.607340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:05.649163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29a203-d006-4702-9c56-78c057ad3eeb service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:05.735938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3959b-893c-4dea-b9b3-550795fb048e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:05.740285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3959b-893c-4dea-b9b3-550795fb048e service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:05.740285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3959b-893c-4dea-b9b3-550795fb048e service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:05.740285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3959b-893c-4dea-b9b3-550795fb048e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:05.746424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3959b-893c-4dea-b9b3-550795fb048e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:05.748124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3959b-893c-4dea-b9b3-550795fb048e service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:05.757928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 864/1704] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:05.759960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3959b-893c-4dea-b9b3-550795fb048e service nova] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:05.761304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b5c3959b-893c-4dea-b9b3-550795fb048e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:05.775203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3959b-893c-4dea-b9b3-550795fb048e service nova] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:05.780236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:05.781149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:05.781398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:05.781730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] PATH_INFO: `/v3/projects/195b0adcf9f14419a3ec66c1ca374b86` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:05.782929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195b0adcf9f14419a3ec66c1ca374b86)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:05.799506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:06.043811 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648670aa855a4f7185c621b7006774da'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.058917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648670aa855a4f7185c621b7006774da'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.066596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195b0adcf9f14419a3ec66c1ca374b86', 'request_id': 'req-47584881-78ea-42df-818e-6dcfd94de6e1'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.100301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195b0adcf9f14419a3ec66c1ca374b86', 'request_id': 'req-47584881-78ea-42df-818e-6dcfd94de6e1'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.105877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195b0adcf9f14419a3ec66c1ca374b86', 'request_id': 'req-47584881-78ea-42df-818e-6dcfd94de6e1'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.148742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648670aa855a4f7185c621b7006774da'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.150457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:06.151233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648670aa855a4f7185c621b7006774da'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.151932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-078dafa6-865e-4b9d-9cbd-58dd9f4b6035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648670aa855a4f7185c621b7006774da'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.177872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 841/1705] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:05 2022] DELETE /identity/v3/users/648670aa855a4f7185c621b7006774da => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:06.179438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53681b75-e21b-40f2-ac43-e0e1bebafa28 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:06.179731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53681b75-e21b-40f2-ac43-e0e1bebafa28 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:06.181710 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53681b75-e21b-40f2-ac43-e0e1bebafa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:06.211430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-53681b75-e21b-40f2-ac43-e0e1bebafa28 None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:06.213649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-53681b75-e21b-40f2-ac43-e0e1bebafa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:06.275560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] The token cache is being invalidate because project 195b0adcf9f14419a3ec66c1ca374b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:06.275864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.276532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:06.278406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 865/1706] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:05 2022] DELETE /identity/v3/projects/195b0adcf9f14419a3ec66c1ca374b86 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:06.281465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:06.281465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:06.306691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 842/1707] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:52:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:06.308262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89dfc-e1ab-4755-b589-93bd4d34d1a7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:06.315695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89dfc-e1ab-4755-b589-93bd4d34d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:06.316117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89dfc-e1ab-4755-b589-93bd4d34d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:06.353592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-a8b89dfc-e1ab-4755-b589-93bd4d34d1a7 None None] MFA Rules not processed for user `0305f1f0b7c64f25a078156c8be1457e`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:06.359887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a8b89dfc-e1ab-4755-b589-93bd4d34d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:06.482682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584881-78ea-42df-818e-6dcfd94de6e1 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:06.509989 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 843/1708] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:06.511825 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc6537-6f2f-4fcb-b1dd-36c3671bb26c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:06.512015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc6537-6f2f-4fcb-b1dd-36c3671bb26c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:06.512400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc6537-6f2f-4fcb-b1dd-36c3671bb26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:06.559433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-39cc6537-6f2f-4fcb-b1dd-36c3671bb26c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:06.563785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-39cc6537-6f2f-4fcb-b1dd-36c3671bb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:06.618114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:06.619256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:06.619744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:06.623749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] PATH_INFO: `/v3/users/5d745e4dd1b742f7a7e1255bb4ffd664` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:06.623749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d745e4dd1b742f7a7e1255bb4ffd664)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:06.623749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:06.706281 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 844/1709] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:06.707082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc6537-6f2f-4fcb-b1dd-36c3671bb26c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:06.708817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-39cc6537-6f2f-4fcb-b1dd-36c3671bb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:06.723328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc6537-6f2f-4fcb-b1dd-36c3671bb26c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:06.729851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:06.730900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:06.731188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:06.731505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] PATH_INFO: `/v3/users/5223855cf08a49fa8184091d1d1b98f3` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:06.732745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5223855cf08a49fa8184091d1d1b98f3)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:06.735215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:06.738791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:06.986764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d745e4dd1b742f7a7e1255bb4ffd664'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.005790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d745e4dd1b742f7a7e1255bb4ffd664'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.019016 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5223855cf08a49fa8184091d1d1b98f3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.031898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5223855cf08a49fa8184091d1d1b98f3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.090701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d745e4dd1b742f7a7e1255bb4ffd664'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.099655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d745e4dd1b742f7a7e1255bb4ffd664'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.101841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ab220ff4-5f81-44f7-bd7d-9ad92fe47728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d745e4dd1b742f7a7e1255bb4ffd664'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.118228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 866/1710] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:06 2022] DELETE /identity/v3/users/5d745e4dd1b742f7a7e1255bb4ffd664 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:07.124838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8e297-f4b8-44ef-ad07-4274781486d0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.125363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8e297-f4b8-44ef-ad07-4274781486d0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.125808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8e297-f4b8-44ef-ad07-4274781486d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.148002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-34e8e297-f4b8-44ef-ad07-4274781486d0 None None] MFA Rules not processed for user `024e0e53cfdb42e88dfdfde7a79e8c75`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:07.149433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-34e8e297-f4b8-44ef-ad07-4274781486d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:07.189790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5223855cf08a49fa8184091d1d1b98f3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.191505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5223855cf08a49fa8184091d1d1b98f3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.192579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5223855cf08a49fa8184091d1d1b98f3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:07.225954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 867/1711] 10.222.0.83 () {58 vars in 1015 bytes} [Fri Jun 17 08:52:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:07.227011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8e297-f4b8-44ef-ad07-4274781486d0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:07.228596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-34e8e297-f4b8-44ef-ad07-4274781486d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:07.241137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8e297-f4b8-44ef-ad07-4274781486d0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:07.246589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 845/1712] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:06 2022] DELETE /identity/v3/users/5223855cf08a49fa8184091d1d1b98f3 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:07.250458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798c81-afa6-4f0b-8814-beb9a0c91347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:07.251407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798c81-afa6-4f0b-8814-beb9a0c91347 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.251523 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:07.251828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798c81-afa6-4f0b-8814-beb9a0c91347 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.252178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798c81-afa6-4f0b-8814-beb9a0c91347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.253934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:07.255175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7f798c81-afa6-4f0b-8814-beb9a0c91347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:07.358290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4bea1-19c2-4c99-a6ef-56d1abc87a25 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:07.372772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12a0ed-b67a-4da1-8e1e-3866f3ddcc2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:07.374413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12a0ed-b67a-4da1-8e1e-3866f3ddcc2c service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.374889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12a0ed-b67a-4da1-8e1e-3866f3ddcc2c service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.375388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12a0ed-b67a-4da1-8e1e-3866f3ddcc2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.379948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1a12a0ed-b67a-4da1-8e1e-3866f3ddcc2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:07.406284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f798c81-afa6-4f0b-8814-beb9a0c91347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:07.414940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f798c81-afa6-4f0b-8814-beb9a0c91347 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:07.449291 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 868/1713] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:07.451104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798c81-afa6-4f0b-8814-beb9a0c91347 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:07.456104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7f798c81-afa6-4f0b-8814-beb9a0c91347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:07.497717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798c81-afa6-4f0b-8814-beb9a0c91347 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:07.549901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12a0ed-b67a-4da1-8e1e-3866f3ddcc2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:07.557888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12a0ed-b67a-4da1-8e1e-3866f3ddcc2c service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:07.574644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 846/1714] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:52:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:52:07.576465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd851a-1f0b-4687-adb9-9dd2c8a0d115 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.576770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd851a-1f0b-4687-adb9-9dd2c8a0d115 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.577048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd851a-1f0b-4687-adb9-9dd2c8a0d115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.633321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8abd851a-1f0b-4687-adb9-9dd2c8a0d115 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:07.634180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8abd851a-1f0b-4687-adb9-9dd2c8a0d115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:07.643836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:07.644745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.645093 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.645565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] PATH_INFO: `/v3/projects/8f743036f812432b8f6be62f76c29570` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.647671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f743036f812432b8f6be62f76c29570)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:07.650021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:07.660962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 847/1715] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:07.661561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd851a-1f0b-4687-adb9-9dd2c8a0d115 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:07.687318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:07.842622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd851a-1f0b-4687-adb9-9dd2c8a0d115 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:07.861100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657b35-fb8e-49c8-958a-2669f81cd108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:07.862049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657b35-fb8e-49c8-958a-2669f81cd108 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.862552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657b35-fb8e-49c8-958a-2669f81cd108 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.862716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657b35-fb8e-49c8-958a-2669f81cd108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.873080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2657b35-fb8e-49c8-958a-2669f81cd108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:07.874756 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2657b35-fb8e-49c8-958a-2669f81cd108 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:07.885443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 848/1716] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:07.886432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657b35-fb8e-49c8-958a-2669f81cd108 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:07.888225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f2657b35-fb8e-49c8-958a-2669f81cd108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:07.904106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657b35-fb8e-49c8-958a-2669f81cd108 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:07.908608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b0cfb-bc1d-4409-879f-62e2cd768b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:07.909975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b0cfb-bc1d-4409-879f-62e2cd768b15 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.910266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b0cfb-bc1d-4409-879f-62e2cd768b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.910551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b0cfb-bc1d-4409-879f-62e2cd768b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.920596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b0cfb-bc1d-4409-879f-62e2cd768b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:07.922641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b0cfb-bc1d-4409-879f-62e2cd768b15 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:07.937052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 849/1717] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:07.938266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b0cfb-bc1d-4409-879f-62e2cd768b15 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:07.953719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b0cfb-bc1d-4409-879f-62e2cd768b15 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:07.961742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a2270-0bdd-4c21-9210-8641dfbadee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:07.963134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a2270-0bdd-4c21-9210-8641dfbadee1 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:07.963702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a2270-0bdd-4c21-9210-8641dfbadee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:07.964131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a2270-0bdd-4c21-9210-8641dfbadee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:07.981538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a2270-0bdd-4c21-9210-8641dfbadee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:07.983954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a2270-0bdd-4c21-9210-8641dfbadee1 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:08.002650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 850/1718] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:08.010061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f743036f812432b8f6be62f76c29570', 'request_id': 'req-185ad654-8da8-4b12-b864-a2e18a2b6db2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:08.027574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f743036f812432b8f6be62f76c29570', 'request_id': 'req-185ad654-8da8-4b12-b864-a2e18a2b6db2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:08.040331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f743036f812432b8f6be62f76c29570', 'request_id': 'req-185ad654-8da8-4b12-b864-a2e18a2b6db2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:08.120372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] The token cache is being invalidate because project 8f743036f812432b8f6be62f76c29570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:08.120974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:08.122951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-185ad654-8da8-4b12-b864-a2e18a2b6db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:08.125595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 869/1719] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:07 2022] DELETE /identity/v3/projects/8f743036f812432b8f6be62f76c29570 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:08.131666 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6047dd-f34b-417a-bf8c-4dbacb4dd920 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.133804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6047dd-f34b-417a-bf8c-4dbacb4dd920 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.134439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6047dd-f34b-417a-bf8c-4dbacb4dd920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.175053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ae6047dd-f34b-417a-bf8c-4dbacb4dd920 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:08.184951 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ae6047dd-f34b-417a-bf8c-4dbacb4dd920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:08.286543 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:08.308326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 851/1720] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:08.317922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aa295-73ae-482d-84b6-0b2f37bb2b50 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.318270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aa295-73ae-482d-84b6-0b2f37bb2b50 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.319190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aa295-73ae-482d-84b6-0b2f37bb2b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.352267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-4d7aa295-73ae-482d-84b6-0b2f37bb2b50 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:08.354121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4d7aa295-73ae-482d-84b6-0b2f37bb2b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:08.373628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6047dd-f34b-417a-bf8c-4dbacb4dd920 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:08.373824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 870/1721] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:08.391760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6047dd-f34b-417a-bf8c-4dbacb4dd920 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:08.405930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be714-c020-4c00-a37e-c4ecdddc4894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:08.406741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be714-c020-4c00-a37e-c4ecdddc4894 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.407279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be714-c020-4c00-a37e-c4ecdddc4894 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.408849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be714-c020-4c00-a37e-c4ecdddc4894 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.419102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2be714-c020-4c00-a37e-c4ecdddc4894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:08.419102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2be714-c020-4c00-a37e-c4ecdddc4894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:08.419102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2be714-c020-4c00-a37e-c4ecdddc4894 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:08.443416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 852/1722] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:08.447648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aa295-73ae-482d-84b6-0b2f37bb2b50 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:08.466688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aa295-73ae-482d-84b6-0b2f37bb2b50 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:08.476440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb026-a1c3-4f98-aac5-a1f347e66e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:08.476440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb026-a1c3-4f98-aac5-a1f347e66e85 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.476440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb026-a1c3-4f98-aac5-a1f347e66e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.476440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb026-a1c3-4f98-aac5-a1f347e66e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.476860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccb026-a1c3-4f98-aac5-a1f347e66e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:08.479203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccb026-a1c3-4f98-aac5-a1f347e66e85 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:08.606454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 871/1723] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:08 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:08.609571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be714-c020-4c00-a37e-c4ecdddc4894 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:08.627565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9420-d30f-432e-a368-9847acbee1a3 None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.630640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9420-d30f-432e-a368-9847acbee1a3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.632876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9420-d30f-432e-a368-9847acbee1a3 None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.633966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be714-c020-4c00-a37e-c4ecdddc4894 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:08.640773 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 872/1724] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:52:08 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:52:08.697852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb64a7-1619-4b4f-8178-938c1b8ea7b2 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.698463 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb64a7-1619-4b4f-8178-938c1b8ea7b2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.699240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb64a7-1619-4b4f-8178-938c1b8ea7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.752246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-bacb64a7-1619-4b4f-8178-938c1b8ea7b2 None None] MFA Rules not processed for user `f79f43c31f5346d5b1e6ae6ff8c511a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:08.756876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-bacb64a7-1619-4b4f-8178-938c1b8ea7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:08.818240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:08.852208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dacc3e-027d-413c-ad6a-72bba4a0bc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:08.856047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dacc3e-027d-413c-ad6a-72bba4a0bc0c admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:08.856876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dacc3e-027d-413c-ad6a-72bba4a0bc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:08.857275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dacc3e-027d-413c-ad6a-72bba4a0bc0c admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:08.858082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dacc3e-027d-413c-ad6a-72bba4a0bc0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:08.864117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dacc3e-027d-413c-ad6a-72bba4a0bc0c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:08.994121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 873/1725] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:09.031871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb64a7-1619-4b4f-8178-938c1b8ea7b2 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:09.034295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-bacb64a7-1619-4b4f-8178-938c1b8ea7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:09.074478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb64a7-1619-4b4f-8178-938c1b8ea7b2 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:09.082760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c5c7f-fa66-417b-b9e7-fb4a6654088f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:09.088060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c5c7f-fa66-417b-b9e7-fb4a6654088f service placement] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:09.088060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c5c7f-fa66-417b-b9e7-fb4a6654088f service placement] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:09.088060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c5c7f-fa66-417b-b9e7-fb4a6654088f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:09.116375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c5c7f-fa66-417b-b9e7-fb4a6654088f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:09.118763 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c5c7f-fa66-417b-b9e7-fb4a6654088f service placement] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:09.154135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 874/1726] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:09.198879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 853/1727] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:08 2022] POST /identity/v3/users => generated 291 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:09.201474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c5c7f-fa66-417b-b9e7-fb4a6654088f service placement] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:09.221547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c5c7f-fa66-417b-b9e7-fb4a6654088f service placement] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:09.221547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db27e4-4c60-4756-a094-2fa27a7c875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:09.221547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db27e4-4c60-4756-a094-2fa27a7c875b admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:09.221547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db27e4-4c60-4756-a094-2fa27a7c875b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:09.221886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db27e4-4c60-4756-a094-2fa27a7c875b admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:09.224436 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db27e4-4c60-4756-a094-2fa27a7c875b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:09.227112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db27e4-4c60-4756-a094-2fa27a7c875b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:09.246884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 875/1728] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:09.247072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dacc3e-027d-413c-ad6a-72bba4a0bc0c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:09.265757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dacc3e-027d-413c-ad6a-72bba4a0bc0c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:09.276991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d999e7d-6b33-4594-ab5a-bbfe29112470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:09.278041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d999e7d-6b33-4594-ab5a-bbfe29112470 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:09.279124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d999e7d-6b33-4594-ab5a-bbfe29112470 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:09.279663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d999e7d-6b33-4594-ab5a-bbfe29112470 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:09.281363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d999e7d-6b33-4594-ab5a-bbfe29112470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:09.283237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d999e7d-6b33-4594-ab5a-bbfe29112470 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:09.313546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 854/1729] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:09.319632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db27e4-4c60-4756-a094-2fa27a7c875b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:09.355039 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db27e4-4c60-4756-a094-2fa27a7c875b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:09.379422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91cb5c-11d8-4234-b9e2-5b40dc337e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:09.380454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91cb5c-11d8-4234-b9e2-5b40dc337e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:09.380611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91cb5c-11d8-4234-b9e2-5b40dc337e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:09.390479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91cb5c-11d8-4234-b9e2-5b40dc337e42 admin admin] PATH_INFO: `/v3/projects/624bcb48062e4a319b34d66739a0e4ca/users/cfd7da3fffea46fa81608ca3fdfc8d39/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:09.436969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91cb5c-11d8-4234-b9e2-5b40dc337e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624bcb48062e4a319b34d66739a0e4ca, user_id=cfd7da3fffea46fa81608ca3fdfc8d39, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:09.439806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91cb5c-11d8-4234-b9e2-5b40dc337e42 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:09.542574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:09.629564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d999e7d-6b33-4594-ab5a-bbfe29112470 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:09.633092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4d999e7d-6b33-4594-ab5a-bbfe29112470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:09.641312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 876/1730] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:09 2022] PUT /identity/v3/projects/624bcb48062e4a319b34d66739a0e4ca/users/cfd7da3fffea46fa81608ca3fdfc8d39/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:09.650064 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d999e7d-6b33-4594-ab5a-bbfe29112470 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:09.652421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af008b3-b3c2-4466-a944-81106dba1c33 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:09.653844 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af008b3-b3c2-4466-a944-81106dba1c33 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:09.655205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af008b3-b3c2-4466-a944-81106dba1c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:09.716572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-0af008b3-b3c2-4466-a944-81106dba1c33 None None] MFA Rules not processed for user `cfd7da3fffea46fa81608ca3fdfc8d39`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:09.722892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0af008b3-b3c2-4466-a944-81106dba1c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:09.815251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:09.816591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:09.816768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:09.817038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] PATH_INFO: `/v3/projects/20dfa666055748de98edfcdb7b46a4c3` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:09.818380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] RBAC: Authorizing `identity:delete_project(project_id=20dfa666055748de98edfcdb7b46a4c3)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:09.821314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:09.865088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 877/1731] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:09.866788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af008b3-b3c2-4466-a944-81106dba1c33 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:09.868254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0af008b3-b3c2-4466-a944-81106dba1c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:09.886161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af008b3-b3c2-4466-a944-81106dba1c33 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:09.906809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:09.908082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:09.908521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:09.908991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] PATH_INFO: `/v3/projects/2fe51fc742db40199cb57db1f9548553` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:09.914582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe51fc742db40199cb57db1f9548553)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:09.917513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:09.992002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20dfa666055748de98edfcdb7b46a4c3', 'request_id': 'req-796c5756-4cfd-4a85-bb71-80bdf462145b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.004822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20dfa666055748de98edfcdb7b46a4c3', 'request_id': 'req-796c5756-4cfd-4a85-bb71-80bdf462145b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.014254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20dfa666055748de98edfcdb7b46a4c3', 'request_id': 'req-796c5756-4cfd-4a85-bb71-80bdf462145b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.104982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe51fc742db40199cb57db1f9548553', 'request_id': 'req-2198ba47-31dd-4359-9154-a2307d1cecab'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.119545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] The token cache is being invalidate because project 20dfa666055748de98edfcdb7b46a4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:10.124410 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.125647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.126722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe51fc742db40199cb57db1f9548553', 'request_id': 'req-2198ba47-31dd-4359-9154-a2307d1cecab'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.133749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 855/1732] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:09 2022] DELETE /identity/v3/projects/20dfa666055748de98edfcdb7b46a4c3 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:10.134992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:10.144708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe51fc742db40199cb57db1f9548553', 'request_id': 'req-2198ba47-31dd-4359-9154-a2307d1cecab'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.184359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:10.297241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] The token cache is being invalidate because project 2fe51fc742db40199cb57db1f9548553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:10.298398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.301013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.307756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 878/1733] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:09 2022] DELETE /identity/v3/projects/2fe51fc742db40199cb57db1f9548553 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:10.308947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:10.314893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:10.366702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5756-4cfd-4a85-bb71-80bdf462145b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:10.439982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198ba47-31dd-4359-9154-a2307d1cecab admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:10.449317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:10.453648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:10.454247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:10.465342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] PATH_INFO: `/v3/projects/b131c0701a0843f193e9a876b03a730c` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:10.471704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b131c0701a0843f193e9a876b03a730c)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:10.474109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:10.561700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c815cf7-5f89-4e8c-b305-a1da2de08be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:10.562951 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c815cf7-5f89-4e8c-b305-a1da2de08be3 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:10.564385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c815cf7-5f89-4e8c-b305-a1da2de08be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:10.564947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c815cf7-5f89-4e8c-b305-a1da2de08be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:10.565775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c815cf7-5f89-4e8c-b305-a1da2de08be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:10.574202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c815cf7-5f89-4e8c-b305-a1da2de08be3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:10.747782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:10.751049 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b131c0701a0843f193e9a876b03a730c', 'request_id': 'req-7ca880aa-e88d-4efd-9414-9df501dd613b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.762357 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b131c0701a0843f193e9a876b03a730c', 'request_id': 'req-7ca880aa-e88d-4efd-9414-9df501dd613b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.764954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 856/1734] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:10 2022] POST /identity/v3/projects => generated 381 bytes in 630 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:10.773002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce989fe6-e4bf-4e10-9b9d-1b1d18f7916f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:10.773293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce989fe6-e4bf-4e10-9b9d-1b1d18f7916f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:10.773576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce989fe6-e4bf-4e10-9b9d-1b1d18f7916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:10.784511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b131c0701a0843f193e9a876b03a730c', 'request_id': 'req-7ca880aa-e88d-4efd-9414-9df501dd613b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.840314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ce989fe6-e4bf-4e10-9b9d-1b1d18f7916f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:10.843689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ce989fe6-e4bf-4e10-9b9d-1b1d18f7916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:10.873897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] The token cache is being invalidate because project b131c0701a0843f193e9a876b03a730c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:10.874727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.875570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:10.879770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 879/1735] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:10 2022] DELETE /identity/v3/projects/b131c0701a0843f193e9a876b03a730c => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:10.880844 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:10.893397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:10.899997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:11.018314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 857/1736] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:11.019441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce989fe6-e4bf-4e10-9b9d-1b1d18f7916f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:11.024225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ce989fe6-e4bf-4e10-9b9d-1b1d18f7916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:11.036560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce989fe6-e4bf-4e10-9b9d-1b1d18f7916f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.056972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9722aa-fbc3-476d-9935-545e8a9640d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.056972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9722aa-fbc3-476d-9935-545e8a9640d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.057411 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca880aa-e88d-4efd-9414-9df501dd613b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.057567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9722aa-fbc3-476d-9935-545e8a9640d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.057567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9722aa-fbc3-476d-9935-545e8a9640d7 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.058143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9722aa-fbc3-476d-9935-545e8a9640d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.064316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9722aa-fbc3-476d-9935-545e8a9640d7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.082669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.087238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.087238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.087238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] PATH_INFO: `/v3/users/e46673698041406194526fac82951b91` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.098965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46673698041406194526fac82951b91)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.106461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.183663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 858/1737] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:11 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:11.193732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b8bb-4cc6-4540-b37c-3e3b6cd4a77a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.195256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b8bb-4cc6-4540-b37c-3e3b6cd4a77a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.195591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b8bb-4cc6-4540-b37c-3e3b6cd4a77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.248526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d118b8bb-4cc6-4540-b37c-3e3b6cd4a77a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:11.249955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d118b8bb-4cc6-4540-b37c-3e3b6cd4a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:11.278039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 859/1738] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:11.282020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a408-ed3a-4c1a-abe5-e9aaba798b12 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.282305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a408-ed3a-4c1a-abe5-e9aaba798b12 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.282678 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a408-ed3a-4c1a-abe5-e9aaba798b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.319798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9df0a408-ed3a-4c1a-abe5-e9aaba798b12 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:11.321322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9df0a408-ed3a-4c1a-abe5-e9aaba798b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:11.330845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 860/1739] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:11.332044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0a408-ed3a-4c1a-abe5-e9aaba798b12 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:11.345363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0a408-ed3a-4c1a-abe5-e9aaba798b12 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.364417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2386c-b27d-4cda-8d6b-4a1fec03a683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.371875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2386c-b27d-4cda-8d6b-4a1fec03a683 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.372465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2386c-b27d-4cda-8d6b-4a1fec03a683 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.384547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2386c-b27d-4cda-8d6b-4a1fec03a683 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.388744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2386c-b27d-4cda-8d6b-4a1fec03a683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.402154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2386c-b27d-4cda-8d6b-4a1fec03a683 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.419306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46673698041406194526fac82951b91'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:11.430683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 861/1740] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:11.430683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f093e2-bf99-43ae-b5db-8a46fe436a9f None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.430683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f093e2-bf99-43ae-b5db-8a46fe436a9f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.430683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f093e2-bf99-43ae-b5db-8a46fe436a9f None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.438141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 862/1741] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:52:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:52:11.440665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbed8-470e-4120-8ef1-e5f516a5e50b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.441897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46673698041406194526fac82951b91'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:11.442719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbed8-470e-4120-8ef1-e5f516a5e50b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.444424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbed8-470e-4120-8ef1-e5f516a5e50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.478059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-acfbbed8-470e-4120-8ef1-e5f516a5e50b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:11.479314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-acfbbed8-470e-4120-8ef1-e5f516a5e50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:11.490925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 863/1742] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:11.491934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbbed8-470e-4120-8ef1-e5f516a5e50b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:11.502446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbbed8-470e-4120-8ef1-e5f516a5e50b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.510835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbd6f2-2f5a-49ab-9c6a-714a2746bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.513166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbd6f2-2f5a-49ab-9c6a-714a2746bb35 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.513464 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbd6f2-2f5a-49ab-9c6a-714a2746bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.513746 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbd6f2-2f5a-49ab-9c6a-714a2746bb35 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.514664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbd6f2-2f5a-49ab-9c6a-714a2746bb35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:11.515629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbd6f2-2f5a-49ab-9c6a-714a2746bb35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.518101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbd6f2-2f5a-49ab-9c6a-714a2746bb35 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.547375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46673698041406194526fac82951b91'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:11.551608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 864/1743] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:11.553754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e9f67-2a89-49fa-8010-a7cf07790cf3 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.554390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e9f67-2a89-49fa-8010-a7cf07790cf3 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.554518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e9f67-2a89-49fa-8010-a7cf07790cf3 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.556964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46673698041406194526fac82951b91'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:11.558924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46673698041406194526fac82951b91'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:11.575608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 880/1744] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:10 2022] DELETE /identity/v3/users/e46673698041406194526fac82951b91 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:11.575608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:11.580706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:11.587403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 865/1745] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:52:11 2022] GET /identity => generated 270 bytes in 35 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:52:11.588986 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e9f67-2a89-49fa-8010-a7cf07790cf3 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:11.601673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-426e9f67-2a89-49fa-8010-a7cf07790cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:11.724496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42711a1-3967-463a-9da4-6065de59868d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.730711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407790-6b55-41dd-836c-ba2bb1327ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.733520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407790-6b55-41dd-836c-ba2bb1327ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.734093 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407790-6b55-41dd-836c-ba2bb1327ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.734822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407790-6b55-41dd-836c-ba2bb1327ce2 admin admin] PATH_INFO: `/v3/projects/6ba06abf899b4cabab7709d7414ee835/users/01659ea9fe4246429996dc320d9481b8/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.757276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25407790-6b55-41dd-836c-ba2bb1327ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba06abf899b4cabab7709d7414ee835, user_id=01659ea9fe4246429996dc320d9481b8, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.761852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25407790-6b55-41dd-836c-ba2bb1327ce2 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.796619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e9f67-2a89-49fa-8010-a7cf07790cf3 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:11.804210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f15b05-3dd5-466f-af01-695fa9f0cb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:11.810050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f15b05-3dd5-466f-af01-695fa9f0cb21 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.810050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f15b05-3dd5-466f-af01-695fa9f0cb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.810050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f15b05-3dd5-466f-af01-695fa9f0cb21 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.810050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f15b05-3dd5-466f-af01-695fa9f0cb21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:11.810050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f15b05-3dd5-466f-af01-695fa9f0cb21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:11.810050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f15b05-3dd5-466f-af01-695fa9f0cb21 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:11.834647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 866/1746] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:11.834647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e574c-1c27-42e1-9a3c-d3fd99de072e None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:11.834647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e574c-1c27-42e1-9a3c-d3fd99de072e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:11.834647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e574c-1c27-42e1-9a3c-d3fd99de072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:11.864236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 881/1747] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:11 2022] PUT /identity/v3/projects/6ba06abf899b4cabab7709d7414ee835/users/01659ea9fe4246429996dc320d9481b8/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:11.867093 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407790-6b55-41dd-836c-ba2bb1327ce2 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:11.870066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-25407790-6b55-41dd-836c-ba2bb1327ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:11.880498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-a97e574c-1c27-42e1-9a3c-d3fd99de072e None None] MFA Rules not processed for user `f79f43c31f5346d5b1e6ae6ff8c511a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:11.882996 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a97e574c-1c27-42e1-9a3c-d3fd99de072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:12.093819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407790-6b55-41dd-836c-ba2bb1327ce2 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:12.108459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534dc2-ef30-4bd4-b3ed-b8f18670e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:12.114017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534dc2-ef30-4bd4-b3ed-b8f18670e25e admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:12.114307 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534dc2-ef30-4bd4-b3ed-b8f18670e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:12.115910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534dc2-ef30-4bd4-b3ed-b8f18670e25e admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:12.116723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534dc2-ef30-4bd4-b3ed-b8f18670e25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:12.119850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 867/1748] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:12.120741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e574c-1c27-42e1-9a3c-d3fd99de072e None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:12.122424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534dc2-ef30-4bd4-b3ed-b8f18670e25e admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:12.122819 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a97e574c-1c27-42e1-9a3c-d3fd99de072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:12.147934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e574c-1c27-42e1-9a3c-d3fd99de072e None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:12.153752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:12.155664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:12.155903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:12.156235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] PATH_INFO: `/v3/users/feabfb90a3b34ed1918ec529d2c46ee0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:12.158204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feabfb90a3b34ed1918ec529d2c46ee0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:12.160901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:12.306201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 882/1749] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:11 2022] POST /identity/v3/projects => generated 379 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:12.320812 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36f7e-70ce-4402-bdf3-1209bc4e5fc3 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:12.322502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36f7e-70ce-4402-bdf3-1209bc4e5fc3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:12.328748 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36f7e-70ce-4402-bdf3-1209bc4e5fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:12.398544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:12.422477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-0eb36f7e-70ce-4402-bdf3-1209bc4e5fc3 None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:12.424101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0eb36f7e-70ce-4402-bdf3-1209bc4e5fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:12.503885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feabfb90a3b34ed1918ec529d2c46ee0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:12.508146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:12.533140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feabfb90a3b34ed1918ec529d2c46ee0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:12.633096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 883/1750] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:52:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:12.633965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb36f7e-70ce-4402-bdf3-1209bc4e5fc3 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:12.678697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feabfb90a3b34ed1918ec529d2c46ee0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:12.679397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feabfb90a3b34ed1918ec529d2c46ee0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:12.680085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-e6323853-1949-4cf6-8ede-1b527d70db98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feabfb90a3b34ed1918ec529d2c46ee0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:12.749991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 868/1751] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:12 2022] DELETE /identity/v3/users/feabfb90a3b34ed1918ec529d2c46ee0 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:12.751753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664ee8c-88a5-4cb5-9507-21d383695cf3 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:12.753029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664ee8c-88a5-4cb5-9507-21d383695cf3 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:12.755955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664ee8c-88a5-4cb5-9507-21d383695cf3 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:12.758968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 869/1752] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:52:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:52:12.768053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664ee8c-88a5-4cb5-9507-21d383695cf3 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:12.776434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5664ee8c-88a5-4cb5-9507-21d383695cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:12.836147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb36f7e-70ce-4402-bdf3-1209bc4e5fc3 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:12.939982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b053c-f4ff-42ff-baef-eb3f63d29907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:12.941106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b053c-f4ff-42ff-baef-eb3f63d29907 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:12.941643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b053c-f4ff-42ff-baef-eb3f63d29907 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:12.942175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b053c-f4ff-42ff-baef-eb3f63d29907 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:12.943090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b053c-f4ff-42ff-baef-eb3f63d29907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:12.946534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b053c-f4ff-42ff-baef-eb3f63d29907 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:12.985569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664ee8c-88a5-4cb5-9507-21d383695cf3 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:12.992655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c1eb6-894d-4fe5-bb38-c2c6447c8633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:12.994186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c1eb6-894d-4fe5-bb38-c2c6447c8633 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:12.994641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c1eb6-894d-4fe5-bb38-c2c6447c8633 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:12.994928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c1eb6-894d-4fe5-bb38-c2c6447c8633 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:12.996001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c1eb6-894d-4fe5-bb38-c2c6447c8633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:12.998091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c1eb6-894d-4fe5-bb38-c2c6447c8633 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:13.021623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 870/1753] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:13.023254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c1eb6-894d-4fe5-bb38-c2c6447c8633 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:13.029354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1f4c1eb6-894d-4fe5-bb38-c2c6447c8633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.073124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 884/1754] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:12 2022] POST /identity/v3/projects => generated 393 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:13.073124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b053c-f4ff-42ff-baef-eb3f63d29907 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:13.076927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-dc6b053c-f4ff-42ff-baef-eb3f63d29907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.184905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:13.213675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c1eb6-894d-4fe5-bb38-c2c6447c8633 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:13.217647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b053c-f4ff-42ff-baef-eb3f63d29907 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:13.232646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c224d-bfad-4e27-bf68-4d3a2bb16858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:13.234893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c224d-bfad-4e27-bf68-4d3a2bb16858 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.237218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c224d-bfad-4e27-bf68-4d3a2bb16858 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.237753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c224d-bfad-4e27-bf68-4d3a2bb16858 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.238593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c224d-bfad-4e27-bf68-4d3a2bb16858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:13.244420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c224d-bfad-4e27-bf68-4d3a2bb16858 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:13.349576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775097d3-38a8-4046-8f43-0540d0f21afd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:13.350840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775097d3-38a8-4046-8f43-0540d0f21afd service placement] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.351132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775097d3-38a8-4046-8f43-0540d0f21afd service placement] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.351452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775097d3-38a8-4046-8f43-0540d0f21afd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.353381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-775097d3-38a8-4046-8f43-0540d0f21afd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.366401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775097d3-38a8-4046-8f43-0540d0f21afd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:13.368167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775097d3-38a8-4046-8f43-0540d0f21afd service placement] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:13.390483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 871/1755] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:13.392029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cdd1b-74eb-49cd-91b7-5d97eb088d9a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.392324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cdd1b-74eb-49cd-91b7-5d97eb088d9a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.392605 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cdd1b-74eb-49cd-91b7-5d97eb088d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.413627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-942cdd1b-74eb-49cd-91b7-5d97eb088d9a None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:13.415063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-942cdd1b-74eb-49cd-91b7-5d97eb088d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.437971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 885/1756] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:13 2022] POST /identity/v3/users => generated 290 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:13.441443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c224d-bfad-4e27-bf68-4d3a2bb16858 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:13.517224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c224d-bfad-4e27-bf68-4d3a2bb16858 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:13.529359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79562493-bd57-4860-b2ef-4914099048bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:13.536418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79562493-bd57-4860-b2ef-4914099048bc admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.538570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79562493-bd57-4860-b2ef-4914099048bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.538804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79562493-bd57-4860-b2ef-4914099048bc admin admin] PATH_INFO: `/v3/projects/6ba06abf899b4cabab7709d7414ee835/users/01659ea9fe4246429996dc320d9481b8/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.542350 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79562493-bd57-4860-b2ef-4914099048bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba06abf899b4cabab7709d7414ee835, user_id=01659ea9fe4246429996dc320d9481b8, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:13.548344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79562493-bd57-4860-b2ef-4914099048bc admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:13.580127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 872/1757] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:52:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:13.585423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cdd1b-74eb-49cd-91b7-5d97eb088d9a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:13.587549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-942cdd1b-74eb-49cd-91b7-5d97eb088d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.596000 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 886/1758] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:13 2022] PUT /identity/v3/projects/6ba06abf899b4cabab7709d7414ee835/users/01659ea9fe4246429996dc320d9481b8/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:13.597290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79562493-bd57-4860-b2ef-4914099048bc admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:13.607550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-79562493-bd57-4860-b2ef-4914099048bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.626772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cdd1b-74eb-49cd-91b7-5d97eb088d9a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:13.803327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79562493-bd57-4860-b2ef-4914099048bc admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:13.806261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cd922-575b-4390-ade9-466628970382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:13.807687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cd922-575b-4390-ade9-466628970382 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.807687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cd922-575b-4390-ade9-466628970382 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.807687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cd922-575b-4390-ade9-466628970382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.812898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-7c3cd922-575b-4390-ade9-466628970382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.815818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930948bc-03c7-48dd-864f-e667b1adcf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:13.816588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930948bc-03c7-48dd-864f-e667b1adcf57 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.817450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930948bc-03c7-48dd-864f-e667b1adcf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.820284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930948bc-03c7-48dd-864f-e667b1adcf57 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.821078 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930948bc-03c7-48dd-864f-e667b1adcf57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:13.825952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930948bc-03c7-48dd-864f-e667b1adcf57 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:13.843222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cd922-575b-4390-ade9-466628970382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:13.844953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cd922-575b-4390-ade9-466628970382 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:13.862528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 873/1759] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:13.863718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cd922-575b-4390-ade9-466628970382 service nova] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:13.875958 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cd922-575b-4390-ade9-466628970382 service nova] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:13.881812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65a3df-baf0-4500-acc0-1a034d5fefb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:13.881812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65a3df-baf0-4500-acc0-1a034d5fefb4 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.883439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65a3df-baf0-4500-acc0-1a034d5fefb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.883439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65a3df-baf0-4500-acc0-1a034d5fefb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.883652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65a3df-baf0-4500-acc0-1a034d5fefb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:13.885529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65a3df-baf0-4500-acc0-1a034d5fefb4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:13.917303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 874/1760] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:13.920916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65a3df-baf0-4500-acc0-1a034d5fefb4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:13.927311 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ac65a3df-baf0-4500-acc0-1a034d5fefb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:13.932785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 887/1761] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:13 2022] POST /identity/v3/users => generated 297 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:13.935543 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3ca5-0726-4c9a-b1b1-e6729f709556 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.936050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3ca5-0726-4c9a-b1b1-e6729f709556 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.936293 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3ca5-0726-4c9a-b1b1-e6729f709556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.970287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65a3df-baf0-4500-acc0-1a034d5fefb4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:13.978510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:13.979836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:13.981988 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:13.982421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] PATH_INFO: `/v3/projects/aa196fc5541548988f15c21fa3927a79` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:13.984955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa196fc5541548988f15c21fa3927a79)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:13.986961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:13.992080 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-7d9f3ca5-0726-4c9a-b1b1-e6729f709556 None None] MFA Rules not processed for user `01659ea9fe4246429996dc320d9481b8`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:13.993635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7d9f3ca5-0726-4c9a-b1b1-e6729f709556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:14.025035 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:14.138287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 888/1762] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:14.139017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3ca5-0726-4c9a-b1b1-e6729f709556 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:14.157197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7d9f3ca5-0726-4c9a-b1b1-e6729f709556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:14.178893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3ca5-0726-4c9a-b1b1-e6729f709556 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:14.180652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa196fc5541548988f15c21fa3927a79', 'request_id': 'req-5f96a15b-e6d8-4e49-8db2-08281539f988'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:14.220405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa196fc5541548988f15c21fa3927a79', 'request_id': 'req-5f96a15b-e6d8-4e49-8db2-08281539f988'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:14.247935 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa196fc5541548988f15c21fa3927a79', 'request_id': 'req-5f96a15b-e6d8-4e49-8db2-08281539f988'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:14.313140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102dee7-fb81-440c-834c-e54daa3ed5c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:14.316865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102dee7-fb81-440c-834c-e54daa3ed5c6 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:14.316865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102dee7-fb81-440c-834c-e54daa3ed5c6 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:14.323805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102dee7-fb81-440c-834c-e54daa3ed5c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:14.337180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102dee7-fb81-440c-834c-e54daa3ed5c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:14.338944 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102dee7-fb81-440c-834c-e54daa3ed5c6 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:14.366210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 889/1763] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:14.367075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102dee7-fb81-440c-834c-e54daa3ed5c6 service nova] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:14.369540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3102dee7-fb81-440c-834c-e54daa3ed5c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:14.383163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] The token cache is being invalidate because project aa196fc5541548988f15c21fa3927a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:14.383163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:14.384395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:14.392180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 875/1764] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:13 2022] DELETE /identity/v3/projects/aa196fc5541548988f15c21fa3927a79 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:14.392180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:14.395750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:14.522353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102dee7-fb81-440c-834c-e54daa3ed5c6 service nova] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:14.534083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:14.535617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:14.535617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:14.535617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] PATH_INFO: `/v3/projects/71724692ece948e8be8b11277eead101` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:14.544405 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71724692ece948e8be8b11277eead101)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:14.546502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:14.561378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96a15b-e6d8-4e49-8db2-08281539f988 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:14.568219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5512e-f3a7-4f8a-b5a1-445e3a1ca28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:14.581242 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5512e-f3a7-4f8a-b5a1-445e3a1ca28c admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:14.581970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5512e-f3a7-4f8a-b5a1-445e3a1ca28c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:14.581970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5512e-f3a7-4f8a-b5a1-445e3a1ca28c admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:14.583172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5512e-f3a7-4f8a-b5a1-445e3a1ca28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:14.586400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:14.588614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5512e-f3a7-4f8a-b5a1-445e3a1ca28c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:14.608383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 876/1765] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:14.609530 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5512e-f3a7-4f8a-b5a1-445e3a1ca28c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:14.614670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a4e5512e-f3a7-4f8a-b5a1-445e3a1ca28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:14.640410 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5512e-f3a7-4f8a-b5a1-445e3a1ca28c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:14.649002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14625666-f4f6-4492-9623-22ba1ebcf26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:14.649856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625666-f4f6-4492-9623-22ba1ebcf26f admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:14.650239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625666-f4f6-4492-9623-22ba1ebcf26f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:14.650624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625666-f4f6-4492-9623-22ba1ebcf26f admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:14.651501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14625666-f4f6-4492-9623-22ba1ebcf26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:14.655205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14625666-f4f6-4492-9623-22ba1ebcf26f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:14.689157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 877/1766] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:14.690233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14625666-f4f6-4492-9623-22ba1ebcf26f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:14.699619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-14625666-f4f6-4492-9623-22ba1ebcf26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:14.734887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71724692ece948e8be8b11277eead101', 'request_id': 'req-738d0e3d-bfaf-422f-8690-78942c7a2ff8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:14.747177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71724692ece948e8be8b11277eead101', 'request_id': 'req-738d0e3d-bfaf-422f-8690-78942c7a2ff8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:14.782341 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71724692ece948e8be8b11277eead101', 'request_id': 'req-738d0e3d-bfaf-422f-8690-78942c7a2ff8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:14.853063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14625666-f4f6-4492-9623-22ba1ebcf26f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:14.860331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] The token cache is being invalidate because project 71724692ece948e8be8b11277eead101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:14.860998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:14.862006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-738d0e3d-bfaf-422f-8690-78942c7a2ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:14.868092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 890/1767] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:14 2022] DELETE /identity/v3/projects/71724692ece948e8be8b11277eead101 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:14.868592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092057e-9495-43f3-a680-ec82ebc1d7ba None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:14.868592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092057e-9495-43f3-a680-ec82ebc1d7ba None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:14.868881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092057e-9495-43f3-a680-ec82ebc1d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:14.921019 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-4092057e-9495-43f3-a680-ec82ebc1d7ba None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:14.922686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4092057e-9495-43f3-a680-ec82ebc1d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:14.939385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887f91-23e8-4699-82c1-59e0379e33ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:14.942526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887f91-23e8-4699-82c1-59e0379e33ad service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:14.942526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887f91-23e8-4699-82c1-59e0379e33ad service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:14.942526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887f91-23e8-4699-82c1-59e0379e33ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:14.945389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4e887f91-23e8-4699-82c1-59e0379e33ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:14.993981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:15.030867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 891/1768] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:15.031910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092057e-9495-43f3-a680-ec82ebc1d7ba None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:15.033399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4092057e-9495-43f3-a680-ec82ebc1d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:15.046797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092057e-9495-43f3-a680-ec82ebc1d7ba None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:15.052839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e73c9-871b-4842-bb25-8e7f1f6243c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:15.053914 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e73c9-871b-4842-bb25-8e7f1f6243c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.054263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e73c9-871b-4842-bb25-8e7f1f6243c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.054623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e73c9-871b-4842-bb25-8e7f1f6243c2 admin admin] PATH_INFO: `/v3/projects/8d29b75a5b644f23bf50726273034a68/users/9e9980f1319b4256945a2d7fa326c8af/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.074294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e73c9-871b-4842-bb25-8e7f1f6243c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d29b75a5b644f23bf50726273034a68, user_id=9e9980f1319b4256945a2d7fa326c8af, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:15.077822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e73c9-871b-4842-bb25-8e7f1f6243c2 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:15.124258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e887f91-23e8-4699-82c1-59e0379e33ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:15.125781 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e887f91-23e8-4699-82c1-59e0379e33ad service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:15.157841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 892/1769] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:15 2022] PUT /identity/v3/projects/8d29b75a5b644f23bf50726273034a68/users/9e9980f1319b4256945a2d7fa326c8af/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:15.159688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e73c9-871b-4842-bb25-8e7f1f6243c2 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:15.161697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 878/1770] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:15.163362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887f91-23e8-4699-82c1-59e0379e33ad service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:15.170707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3a0e73c9-871b-4842-bb25-8e7f1f6243c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:15.172841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4e887f91-23e8-4699-82c1-59e0379e33ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:15.220292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887f91-23e8-4699-82c1-59e0379e33ad service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:15.284902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e73c9-871b-4842-bb25-8e7f1f6243c2 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:15.300029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb0746-335d-4016-b070-f44d527b7237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:15.300980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb0746-335d-4016-b070-f44d527b7237 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.301412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb0746-335d-4016-b070-f44d527b7237 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.301833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb0746-335d-4016-b070-f44d527b7237 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.302884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb0746-335d-4016-b070-f44d527b7237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:15.306374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb0746-335d-4016-b070-f44d527b7237 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:15.318243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 893/1771] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:15.321107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babda955-841c-4d91-94af-2a7896be116d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.321637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babda955-841c-4d91-94af-2a7896be116d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.322067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babda955-841c-4d91-94af-2a7896be116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.343384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-babda955-841c-4d91-94af-2a7896be116d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:15.345179 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-babda955-841c-4d91-94af-2a7896be116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:15.355169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 894/1772] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:15.356664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3e2fe-bab6-48f5-83e5-a6b77f6a4702 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.356962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3e2fe-bab6-48f5-83e5-a6b77f6a4702 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.357245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3e2fe-bab6-48f5-83e5-a6b77f6a4702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.414269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-28d3e2fe-bab6-48f5-83e5-a6b77f6a4702 None None] MFA Rules not processed for user `9e9980f1319b4256945a2d7fa326c8af`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:15.416723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:15.417616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.417906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.418186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] PATH_INFO: `/v3/users/0305f1f0b7c64f25a078156c8be1457e` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.419694 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0305f1f0b7c64f25a078156c8be1457e)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:15.421548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-28d3e2fe-bab6-48f5-83e5-a6b77f6a4702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:15.423270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:15.558338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 895/1773] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:15.559370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3e2fe-bab6-48f5-83e5-a6b77f6a4702 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:15.575413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3e2fe-bab6-48f5-83e5-a6b77f6a4702 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:15.581222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e456-7eea-484f-abf2-3428c42e0830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:15.582205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e456-7eea-484f-abf2-3428c42e0830 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.582549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e456-7eea-484f-abf2-3428c42e0830 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.583043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e456-7eea-484f-abf2-3428c42e0830 admin admin] PATH_INFO: `/v3/projects/8af9779d5d82490788251b8cb8d3a5cc/users/b05e1f5d2346429f993f504451c6af09/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.607023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2e456-7eea-484f-abf2-3428c42e0830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af9779d5d82490788251b8cb8d3a5cc, user_id=b05e1f5d2346429f993f504451c6af09, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:15.610764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2e456-7eea-484f-abf2-3428c42e0830 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:15.679921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 896/1774] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:15 2022] PUT /identity/v3/projects/8af9779d5d82490788251b8cb8d3a5cc/users/b05e1f5d2346429f993f504451c6af09/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:15.689161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e456-7eea-484f-abf2-3428c42e0830 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:15.691108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0305f1f0b7c64f25a078156c8be1457e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.709924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0305f1f0b7c64f25a078156c8be1457e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.789846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e456-7eea-484f-abf2-3428c42e0830 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:15.794845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cd54f-c033-4ca0-94da-34d6e285fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:15.795614 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cd54f-c033-4ca0-94da-34d6e285fbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.795904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cd54f-c033-4ca0-94da-34d6e285fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.796191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cd54f-c033-4ca0-94da-34d6e285fbf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.796928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cd54f-c033-4ca0-94da-34d6e285fbf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:15.797378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cd54f-c033-4ca0-94da-34d6e285fbf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:15.799006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cd54f-c033-4ca0-94da-34d6e285fbf0 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:15.804944 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0305f1f0b7c64f25a078156c8be1457e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.805864 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0305f1f0b7c64f25a078156c8be1457e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.808923 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0305f1f0b7c64f25a078156c8be1457e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:15.816354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 897/1775] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:15.816354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cd54f-c033-4ca0-94da-34d6e285fbf0 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:15.816354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-660cd54f-c033-4ca0-94da-34d6e285fbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:15.846344 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 879/1776] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:15 2022] DELETE /identity/v3/users/0305f1f0b7c64f25a078156c8be1457e => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:15.847412 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:15.851287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:15.936266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cd54f-c033-4ca0-94da-34d6e285fbf0 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:15.957075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b92d6-b659-4023-8408-797b3d8ca41a admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:15.966001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdebe1-7e0e-4a61-93a8-082668974e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:15.966696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdebe1-7e0e-4a61-93a8-082668974e13 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:15.966983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdebe1-7e0e-4a61-93a8-082668974e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:15.967267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdebe1-7e0e-4a61-93a8-082668974e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:15.968079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdebe1-7e0e-4a61-93a8-082668974e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:15.974013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdebe1-7e0e-4a61-93a8-082668974e13 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:15.993362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:16.025306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950be14a-c8be-479c-af80-47cbb84656bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.026598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be14a-c8be-479c-af80-47cbb84656bb service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.027160 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be14a-c8be-479c-af80-47cbb84656bb service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.027695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be14a-c8be-479c-af80-47cbb84656bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.030014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-950be14a-c8be-479c-af80-47cbb84656bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.074520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 880/1777] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:15 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:16.079792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a03f13-7d31-4e54-8a0d-3b2295075510 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.080088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a03f13-7d31-4e54-8a0d-3b2295075510 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.080376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a03f13-7d31-4e54-8a0d-3b2295075510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.118610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950be14a-c8be-479c-af80-47cbb84656bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.120134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950be14a-c8be-479c-af80-47cbb84656bb service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.129185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-29a03f13-7d31-4e54-8a0d-3b2295075510 None None] MFA Rules not processed for user `b05e1f5d2346429f993f504451c6af09`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:16.130107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 898/1778] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:16.130829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950be14a-c8be-479c-af80-47cbb84656bb service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:16.131254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-29a03f13-7d31-4e54-8a0d-3b2295075510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.135088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-950be14a-c8be-479c-af80-47cbb84656bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.148811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950be14a-c8be-479c-af80-47cbb84656bb service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:16.244406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 881/1779] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:16.244406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a03f13-7d31-4e54-8a0d-3b2295075510 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:16.244702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce87b9b-83fe-4919-bfab-0d7517695d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.244702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce87b9b-83fe-4919-bfab-0d7517695d7e admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.244702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce87b9b-83fe-4919-bfab-0d7517695d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.244702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce87b9b-83fe-4919-bfab-0d7517695d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.245260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce87b9b-83fe-4919-bfab-0d7517695d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.247800 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce87b9b-83fe-4919-bfab-0d7517695d7e admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.268677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a03f13-7d31-4e54-8a0d-3b2295075510 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:16.278594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8b0a0-f524-4c1a-b486-32cace59f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.285910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8b0a0-f524-4c1a-b486-32cace59f3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.285910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8b0a0-f524-4c1a-b486-32cace59f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.285910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8b0a0-f524-4c1a-b486-32cace59f3b5 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.285910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8b0a0-f524-4c1a-b486-32cace59f3b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.285910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8b0a0-f524-4c1a-b486-32cace59f3b5 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.422311 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 882/1780] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:16 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:16.423553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8b0a0-f524-4c1a-b486-32cace59f3b5 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:16.427191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b2f8b0a0-f524-4c1a-b486-32cace59f3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.427584 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 899/1781] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:16 2022] POST /identity/v3/projects => generated 377 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:16.428648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce87b9b-83fe-4919-bfab-0d7517695d7e admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:16.432173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2ce87b9b-83fe-4919-bfab-0d7517695d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.449167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8b0a0-f524-4c1a-b486-32cace59f3b5 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:16.541355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce87b9b-83fe-4919-bfab-0d7517695d7e admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:16.550678 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a341503-222a-4f1f-a0c6-efcd44356cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.551587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.552766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.553111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.553453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] PATH_INFO: `/v3/projects/2394b46b1dd44fef96398c1f78ac12a4` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.554760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2394b46b1dd44fef96398c1f78ac12a4)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.556012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a341503-222a-4f1f-a0c6-efcd44356cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.556699 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a341503-222a-4f1f-a0c6-efcd44356cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.557215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.557690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a341503-222a-4f1f-a0c6-efcd44356cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.559242 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a341503-222a-4f1f-a0c6-efcd44356cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.564078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a341503-222a-4f1f-a0c6-efcd44356cb5 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.706298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 883/1782] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:16 2022] POST /identity/v3/projects => generated 391 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:16.709091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a341503-222a-4f1f-a0c6-efcd44356cb5 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:16.771532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2394b46b1dd44fef96398c1f78ac12a4', 'request_id': 'req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.785410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2394b46b1dd44fef96398c1f78ac12a4', 'request_id': 'req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.791576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2394b46b1dd44fef96398c1f78ac12a4', 'request_id': 'req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.816565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:16.822414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a341503-222a-4f1f-a0c6-efcd44356cb5 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:16.902145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] The token cache is being invalidate because project 2394b46b1dd44fef96398c1f78ac12a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:16.902482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.903217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:16.908655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 900/1783] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:16 2022] DELETE /identity/v3/projects/2394b46b1dd44fef96398c1f78ac12a4 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:16.909360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ba425-46bc-44de-a521-4159403f8519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.909564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:16.910693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba425-46bc-44de-a521-4159403f8519 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.911185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba425-46bc-44de-a521-4159403f8519 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.911761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba425-46bc-44de-a521-4159403f8519 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.912942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ba425-46bc-44de-a521-4159403f8519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.913053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.915080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ba425-46bc-44de-a521-4159403f8519 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.931213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 884/1784] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:16.932520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ba425-46bc-44de-a521-4159403f8519 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:16.936492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a61ba425-46bc-44de-a521-4159403f8519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:16.940038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8cae2-3921-4a72-b9d1-6e55ddc11b05 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:16.953036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ba425-46bc-44de-a521-4159403f8519 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:16.955087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a0022-529c-40a9-9c09-96a07d68cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.958473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb59ed4-d9a4-4412-a4bf-9c033cc97f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:16.959792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb59ed4-d9a4-4412-a4bf-9c033cc97f71 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.960146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb59ed4-d9a4-4412-a4bf-9c033cc97f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.960417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb59ed4-d9a4-4412-a4bf-9c033cc97f71 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.961163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb59ed4-d9a4-4412-a4bf-9c033cc97f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.961406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0022-529c-40a9-9c09-96a07d68cc4d admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:16.961648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0022-529c-40a9-9c09-96a07d68cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:16.961983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0022-529c-40a9-9c09-96a07d68cc4d admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:16.962793 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a0022-529c-40a9-9c09-96a07d68cc4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:16.963620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb59ed4-d9a4-4412-a4bf-9c033cc97f71 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:16.968443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a0022-529c-40a9-9c09-96a07d68cc4d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.100771 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 885/1785] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:16 2022] POST /identity/v3/users => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:17.107542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b45d55-1b1f-4e60-8565-49f83282bf97 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.108990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b45d55-1b1f-4e60-8565-49f83282bf97 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.109333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b45d55-1b1f-4e60-8565-49f83282bf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.131118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 901/1786] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:16 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:17.131118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a0022-529c-40a9-9c09-96a07d68cc4d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.134512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-575a0022-529c-40a9-9c09-96a07d68cc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:17.151903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a0022-529c-40a9-9c09-96a07d68cc4d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.152435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d8b45d55-1b1f-4e60-8565-49f83282bf97 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:17.154395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d8b45d55-1b1f-4e60-8565-49f83282bf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:17.157167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c697d30-0b49-4a08-97cd-98b473317a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.158128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c697d30-0b49-4a08-97cd-98b473317a45 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.158604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c697d30-0b49-4a08-97cd-98b473317a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.159217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c697d30-0b49-4a08-97cd-98b473317a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.160251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c697d30-0b49-4a08-97cd-98b473317a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.162798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c697d30-0b49-4a08-97cd-98b473317a45 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.165564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 886/1787] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:17.175455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b45d55-1b1f-4e60-8565-49f83282bf97 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.179934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 902/1788] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:17.180879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c697d30-0b49-4a08-97cd-98b473317a45 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.205219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b45d55-1b1f-4e60-8565-49f83282bf97 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.209669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c697d30-0b49-4a08-97cd-98b473317a45 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.211844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931665-c768-4d7f-84ef-83ad0cd0dc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.212617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931665-c768-4d7f-84ef-83ad0cd0dc73 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.213014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931665-c768-4d7f-84ef-83ad0cd0dc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.213384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931665-c768-4d7f-84ef-83ad0cd0dc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.214243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04931665-c768-4d7f-84ef-83ad0cd0dc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.216588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb14201-8209-4e1c-aa7c-a44fe9fdaf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.216786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04931665-c768-4d7f-84ef-83ad0cd0dc73 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.217617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14201-8209-4e1c-aa7c-a44fe9fdaf00 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.217964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14201-8209-4e1c-aa7c-a44fe9fdaf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.218330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14201-8209-4e1c-aa7c-a44fe9fdaf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.218954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb14201-8209-4e1c-aa7c-a44fe9fdaf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.220680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb14201-8209-4e1c-aa7c-a44fe9fdaf00 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.232427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 887/1789] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:17.232877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 903/1790] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:17.233818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb14201-8209-4e1c-aa7c-a44fe9fdaf00 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.237437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6422367-11bd-40ef-a1b6-7cc39bc01f6f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.237765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6422367-11bd-40ef-a1b6-7cc39bc01f6f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.238122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6422367-11bd-40ef-a1b6-7cc39bc01f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.256687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb14201-8209-4e1c-aa7c-a44fe9fdaf00 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.261503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f6422367-11bd-40ef-a1b6-7cc39bc01f6f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:17.262923 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f6422367-11bd-40ef-a1b6-7cc39bc01f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:17.269003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390db4-682f-40e8-a28a-b9ba0a8448b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.269849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390db4-682f-40e8-a28a-b9ba0a8448b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.270129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390db4-682f-40e8-a28a-b9ba0a8448b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.270409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75390db4-682f-40e8-a28a-b9ba0a8448b5 admin admin] PATH_INFO: `/v3/projects/0454e7ce92224614aebe8bf6670915e7/users/5eac2aef23a047009e388285fa636a63/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.285521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 888/1791] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:17.288680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6422367-11bd-40ef-a1b6-7cc39bc01f6f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.291721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75390db4-682f-40e8-a28a-b9ba0a8448b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0454e7ce92224614aebe8bf6670915e7, user_id=5eac2aef23a047009e388285fa636a63, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.292831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75390db4-682f-40e8-a28a-b9ba0a8448b5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.308500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6422367-11bd-40ef-a1b6-7cc39bc01f6f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.314801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2a701-4f81-4786-bf1c-abe3d6a1de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.315519 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2a701-4f81-4786-bf1c-abe3d6a1de94 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.315801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2a701-4f81-4786-bf1c-abe3d6a1de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.316067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2a701-4f81-4786-bf1c-abe3d6a1de94 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.318925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2a701-4f81-4786-bf1c-abe3d6a1de94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.319032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2a701-4f81-4786-bf1c-abe3d6a1de94 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.337551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 889/1792] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:17.338604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2a701-4f81-4786-bf1c-abe3d6a1de94 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.352273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2a701-4f81-4786-bf1c-abe3d6a1de94 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.358588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f9e61-7ae2-4b43-bd2e-f572ba27e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.359780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f9e61-7ae2-4b43-bd2e-f572ba27e833 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.360179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f9e61-7ae2-4b43-bd2e-f572ba27e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.360463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f9e61-7ae2-4b43-bd2e-f572ba27e833 admin admin] PATH_INFO: `/v3/projects/34c393f1558048d191fceb72b7559e02/users/55056ac51bca4d3aafb071447f0accae/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.380368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f9e61-7ae2-4b43-bd2e-f572ba27e833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c393f1558048d191fceb72b7559e02, user_id=55056ac51bca4d3aafb071447f0accae, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.383804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 904/1793] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:17 2022] PUT /identity/v3/projects/0454e7ce92224614aebe8bf6670915e7/users/5eac2aef23a047009e388285fa636a63/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:17.383804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390db4-682f-40e8-a28a-b9ba0a8448b5 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.383963 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f9e61-7ae2-4b43-bd2e-f572ba27e833 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.466821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75390db4-682f-40e8-a28a-b9ba0a8448b5 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.472292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5f265-8dd6-44aa-bba3-885fda52bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.473156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f265-8dd6-44aa-bba3-885fda52bb2b admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.473442 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f265-8dd6-44aa-bba3-885fda52bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.474044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5f265-8dd6-44aa-bba3-885fda52bb2b admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.474975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5f265-8dd6-44aa-bba3-885fda52bb2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:17.475145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5f265-8dd6-44aa-bba3-885fda52bb2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.482825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5f265-8dd6-44aa-bba3-885fda52bb2b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.495411 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 905/1794] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:17.496300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5f265-8dd6-44aa-bba3-885fda52bb2b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.512152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5f265-8dd6-44aa-bba3-885fda52bb2b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.522542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 890/1795] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:17 2022] PUT /identity/v3/projects/34c393f1558048d191fceb72b7559e02/users/55056ac51bca4d3aafb071447f0accae/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:17.522542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe825980-f85d-49cb-adb5-466b74f7d8c5 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.522542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe825980-f85d-49cb-adb5-466b74f7d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.522542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe825980-f85d-49cb-adb5-466b74f7d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.553117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-fe825980-f85d-49cb-adb5-466b74f7d8c5 None None] MFA Rules not processed for user `5eac2aef23a047009e388285fa636a63`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:17.555150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-fe825980-f85d-49cb-adb5-466b74f7d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:17.633467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9b86c-5528-4666-a33e-3d2144cc393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.634658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b86c-5528-4666-a33e-3d2144cc393b admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.634836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b86c-5528-4666-a33e-3d2144cc393b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.635098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9b86c-5528-4666-a33e-3d2144cc393b admin admin] PATH_INFO: `/v3/projects/87fc2e69ae0e4aa2a89ff5a26cba5d06/users/fb55dda3375d4b9dbbea89e45536f389/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.635736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:17.672528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 891/1796] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:17.673984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe825980-f85d-49cb-adb5-466b74f7d8c5 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.677382 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9b86c-5528-4666-a33e-3d2144cc393b admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fc2e69ae0e4aa2a89ff5a26cba5d06, user_id=fb55dda3375d4b9dbbea89e45536f389, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.688434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9b86c-5528-4666-a33e-3d2144cc393b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.694206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe825980-f85d-49cb-adb5-466b74f7d8c5 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.697434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e125c8-8c12-4a29-bea7-f0b1af39478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:17.698393 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e125c8-8c12-4a29-bea7-f0b1af39478b admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:17.699102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e125c8-8c12-4a29-bea7-f0b1af39478b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:17.699594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e125c8-8c12-4a29-bea7-f0b1af39478b admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:17.700507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e125c8-8c12-4a29-bea7-f0b1af39478b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:17.702862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e125c8-8c12-4a29-bea7-f0b1af39478b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:17.812259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 906/1797] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:17 2022] PUT /identity/v3/projects/87fc2e69ae0e4aa2a89ff5a26cba5d06/users/fb55dda3375d4b9dbbea89e45536f389/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:17.813145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9b86c-5528-4666-a33e-3d2144cc393b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.873618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 892/1798] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:17.875251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e125c8-8c12-4a29-bea7-f0b1af39478b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:17.910329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9b86c-5528-4666-a33e-3d2144cc393b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.992365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e125c8-8c12-4a29-bea7-f0b1af39478b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:17.999139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da107cf-4ad1-4663-850e-0c729c4aa0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.000149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da107cf-4ad1-4663-850e-0c729c4aa0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.000452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da107cf-4ad1-4663-850e-0c729c4aa0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.000735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da107cf-4ad1-4663-850e-0c729c4aa0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.001603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da107cf-4ad1-4663-850e-0c729c4aa0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.004174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da107cf-4ad1-4663-850e-0c729c4aa0a6 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.005526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243786b7-6276-48d3-9683-8c8faa23e5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.012014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243786b7-6276-48d3-9683-8c8faa23e5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.014084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243786b7-6276-48d3-9683-8c8faa23e5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.014444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243786b7-6276-48d3-9683-8c8faa23e5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.017787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243786b7-6276-48d3-9683-8c8faa23e5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.023272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243786b7-6276-48d3-9683-8c8faa23e5c8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.055755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 907/1799] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:18.057238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76556b-df60-478e-8d94-defbdcb6da96 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.057611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76556b-df60-478e-8d94-defbdcb6da96 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.057970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76556b-df60-478e-8d94-defbdcb6da96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.120770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 893/1800] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:17 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:18.120770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da107cf-4ad1-4663-850e-0c729c4aa0a6 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.127822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-ee76556b-df60-478e-8d94-defbdcb6da96 None None] MFA Rules not processed for user `fb55dda3375d4b9dbbea89e45536f389`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:18.129524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ee76556b-df60-478e-8d94-defbdcb6da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:18.262386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da107cf-4ad1-4663-850e-0c729c4aa0a6 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.268380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b8c07-b604-4f35-85a0-ef7efede7f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.268929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 908/1801] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:18.269268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b8c07-b604-4f35-85a0-ef7efede7f87 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.269558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b8c07-b604-4f35-85a0-ef7efede7f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.269902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b8c07-b604-4f35-85a0-ef7efede7f87 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.270749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76556b-df60-478e-8d94-defbdcb6da96 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.270862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b8c07-b604-4f35-85a0-ef7efede7f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.274353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b8c07-b604-4f35-85a0-ef7efede7f87 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.289334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76556b-df60-478e-8d94-defbdcb6da96 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.294249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03449746-c057-4588-90f5-439c7d2a1d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.295245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03449746-c057-4588-90f5-439c7d2a1d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.295642 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03449746-c057-4588-90f5-439c7d2a1d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.296010 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03449746-c057-4588-90f5-439c7d2a1d46 admin admin] PATH_INFO: `/v3/projects/34c393f1558048d191fceb72b7559e02/users/55056ac51bca4d3aafb071447f0accae/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.298078 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03449746-c057-4588-90f5-439c7d2a1d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c393f1558048d191fceb72b7559e02, user_id=55056ac51bca4d3aafb071447f0accae, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.300921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03449746-c057-4588-90f5-439c7d2a1d46 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.322809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 909/1802] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:18 2022] PUT /identity/v3/projects/34c393f1558048d191fceb72b7559e02/users/55056ac51bca4d3aafb071447f0accae/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:18.322809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03449746-c057-4588-90f5-439c7d2a1d46 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.403317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03449746-c057-4588-90f5-439c7d2a1d46 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.408643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9804acd-eea6-4fb6-a48c-97c36428dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.409429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804acd-eea6-4fb6-a48c-97c36428dfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.409740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804acd-eea6-4fb6-a48c-97c36428dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.410007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804acd-eea6-4fb6-a48c-97c36428dfd7 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.410703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9804acd-eea6-4fb6-a48c-97c36428dfd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.412804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 894/1803] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:18 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:18.413864 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b8c07-b604-4f35-85a0-ef7efede7f87 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.420953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9804acd-eea6-4fb6-a48c-97c36428dfd7 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.433930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b8c07-b604-4f35-85a0-ef7efede7f87 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.440221 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bbafe-9b77-44f1-aafa-94550d125890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.441171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bbafe-9b77-44f1-aafa-94550d125890 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.441594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bbafe-9b77-44f1-aafa-94550d125890 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.441940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bbafe-9b77-44f1-aafa-94550d125890 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.442777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bbafe-9b77-44f1-aafa-94550d125890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.445426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bbafe-9b77-44f1-aafa-94550d125890 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.564664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 910/1804] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:18 2022] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:18.565991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d370b8-f094-4537-89b0-48ce7cb2fd21 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.567148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d370b8-f094-4537-89b0-48ce7cb2fd21 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.567702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d370b8-f094-4537-89b0-48ce7cb2fd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.612294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-d8d370b8-f094-4537-89b0-48ce7cb2fd21 None None] MFA Rules not processed for user `55056ac51bca4d3aafb071447f0accae`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:18.616341 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d8d370b8-f094-4537-89b0-48ce7cb2fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:18.619321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 895/1805] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:18 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:18.620770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bbafe-9b77-44f1-aafa-94550d125890 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.705971 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bbafe-9b77-44f1-aafa-94550d125890 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.708682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 911/1806] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:18.710326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d370b8-f094-4537-89b0-48ce7cb2fd21 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.714518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907629fa-6571-40e0-b505-e2b925d6b4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.715509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907629fa-6571-40e0-b505-e2b925d6b4eb admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.715937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907629fa-6571-40e0-b505-e2b925d6b4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.716341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907629fa-6571-40e0-b505-e2b925d6b4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.717808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907629fa-6571-40e0-b505-e2b925d6b4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.720447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907629fa-6571-40e0-b505-e2b925d6b4eb admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.739491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d370b8-f094-4537-89b0-48ce7cb2fd21 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.739664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 896/1807] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:18.739664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907629fa-6571-40e0-b505-e2b925d6b4eb admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.747685 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeadeb-7a47-4381-975c-a8eb3cfe27a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.749152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeadeb-7a47-4381-975c-a8eb3cfe27a0 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.749582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeadeb-7a47-4381-975c-a8eb3cfe27a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.750014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeadeb-7a47-4381-975c-a8eb3cfe27a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.751248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeadeb-7a47-4381-975c-a8eb3cfe27a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.753622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeadeb-7a47-4381-975c-a8eb3cfe27a0 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.766746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 912/1808] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:18.767876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeadeb-7a47-4381-975c-a8eb3cfe27a0 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.771646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-8fdeadeb-7a47-4381-975c-a8eb3cfe27a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:18.778738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907629fa-6571-40e0-b505-e2b925d6b4eb admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.792581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd3bd1-2bdb-495e-87b5-aae04f6ebd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.793343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3bd1-2bdb-495e-87b5-aae04f6ebd0a admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.793704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3bd1-2bdb-495e-87b5-aae04f6ebd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.793982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3bd1-2bdb-495e-87b5-aae04f6ebd0a admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.795028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd3bd1-2bdb-495e-87b5-aae04f6ebd0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.797081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd3bd1-2bdb-495e-87b5-aae04f6ebd0a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.841420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeadeb-7a47-4381-975c-a8eb3cfe27a0 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.845065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441af6b1-0257-4d11-a6b6-2fa848f63fb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.845707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441af6b1-0257-4d11-a6b6-2fa848f63fb9 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.845999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441af6b1-0257-4d11-a6b6-2fa848f63fb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.850904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441af6b1-0257-4d11-a6b6-2fa848f63fb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.859990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441af6b1-0257-4d11-a6b6-2fa848f63fb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.861689 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441af6b1-0257-4d11-a6b6-2fa848f63fb9 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.879234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 913/1809] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:18.887825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441af6b1-0257-4d11-a6b6-2fa848f63fb9 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.892765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441af6b1-0257-4d11-a6b6-2fa848f63fb9 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.899875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec603cb-9433-4a8d-8c5f-4e79c64a17df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.900490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec603cb-9433-4a8d-8c5f-4e79c64a17df admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.900849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec603cb-9433-4a8d-8c5f-4e79c64a17df admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.901204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec603cb-9433-4a8d-8c5f-4e79c64a17df admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.902011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec603cb-9433-4a8d-8c5f-4e79c64a17df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.904072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec603cb-9433-4a8d-8c5f-4e79c64a17df admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:18.919566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 914/1810] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:18.919566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec603cb-9433-4a8d-8c5f-4e79c64a17df admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:18.946207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec603cb-9433-4a8d-8c5f-4e79c64a17df admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:18.946207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351cbb8-40d0-4a78-8d98-270119834cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:18.946207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351cbb8-40d0-4a78-8d98-270119834cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:18.946207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351cbb8-40d0-4a78-8d98-270119834cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:18.946518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351cbb8-40d0-4a78-8d98-270119834cbc admin admin] PATH_INFO: `/v3/projects/0f31e839793d40bb8d87f115cad7316b/users/5c4c78e0e47447a986166b25da0903e2/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:18.960223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351cbb8-40d0-4a78-8d98-270119834cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f31e839793d40bb8d87f115cad7316b, user_id=5c4c78e0e47447a986166b25da0903e2, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:18.963443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351cbb8-40d0-4a78-8d98-270119834cbc admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.027231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 897/1811] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:18 2022] POST /identity/v3/users => generated 295 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:19.030958 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd3bd1-2bdb-495e-87b5-aae04f6ebd0a admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:19.039427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd3bd1-2bdb-495e-87b5-aae04f6ebd0a admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:19.045574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8122ae-5834-4ffb-a13f-d14d0bb014a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:19.046470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8122ae-5834-4ffb-a13f-d14d0bb014a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.046749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8122ae-5834-4ffb-a13f-d14d0bb014a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.047023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8122ae-5834-4ffb-a13f-d14d0bb014a4 admin admin] PATH_INFO: `/v3/projects/ab38778feedf41c29363ded88e587908/users/169dcec2e4364088b4cd4adb74d5f17c/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.065072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8122ae-5834-4ffb-a13f-d14d0bb014a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab38778feedf41c29363ded88e587908, user_id=169dcec2e4364088b4cd4adb74d5f17c, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:19.071170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8122ae-5834-4ffb-a13f-d14d0bb014a4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.107902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 915/1812] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:18 2022] PUT /identity/v3/projects/0f31e839793d40bb8d87f115cad7316b/users/5c4c78e0e47447a986166b25da0903e2/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:19.108816 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351cbb8-40d0-4a78-8d98-270119834cbc admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:19.110415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-5351cbb8-40d0-4a78-8d98-270119834cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:19.168919 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351cbb8-40d0-4a78-8d98-270119834cbc admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:19.172493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72104b1e-66c7-42a2-93f3-cc153b498476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:19.173183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72104b1e-66c7-42a2-93f3-cc153b498476 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.173464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72104b1e-66c7-42a2-93f3-cc153b498476 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.173818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72104b1e-66c7-42a2-93f3-cc153b498476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.175906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-72104b1e-66c7-42a2-93f3-cc153b498476 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:19.217511 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 898/1813] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:19 2022] PUT /identity/v3/projects/ab38778feedf41c29363ded88e587908/users/169dcec2e4364088b4cd4adb74d5f17c/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:19.218511 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8122ae-5834-4ffb-a13f-d14d0bb014a4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:19.237038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72104b1e-66c7-42a2-93f3-cc153b498476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:19.238796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72104b1e-66c7-42a2-93f3-cc153b498476 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.249541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 916/1814] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:19.250367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72104b1e-66c7-42a2-93f3-cc153b498476 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:19.300779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8122ae-5834-4ffb-a13f-d14d0bb014a4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:19.306971 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c27494-9955-461d-8b00-a1c313b8bf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:19.307850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c27494-9955-461d-8b00-a1c313b8bf8d admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.308141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c27494-9955-461d-8b00-a1c313b8bf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.309136 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c27494-9955-461d-8b00-a1c313b8bf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.310437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c27494-9955-461d-8b00-a1c313b8bf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:19.312623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c27494-9955-461d-8b00-a1c313b8bf8d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.328162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 899/1815] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:19.328370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72104b1e-66c7-42a2-93f3-cc153b498476 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:19.328474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9cae8-ba02-478c-9f5a-4a970775cd7b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.328474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9cae8-ba02-478c-9f5a-4a970775cd7b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.328474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9cae8-ba02-478c-9f5a-4a970775cd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.332218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcd437-df48-4191-b8fc-337a23e97add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:19.335868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcd437-df48-4191-b8fc-337a23e97add admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.335868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcd437-df48-4191-b8fc-337a23e97add admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.336138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcd437-df48-4191-b8fc-337a23e97add admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.336941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcd437-df48-4191-b8fc-337a23e97add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:19.338623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcd437-df48-4191-b8fc-337a23e97add admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.357927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 917/1816] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:19.360220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcd437-df48-4191-b8fc-337a23e97add admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:19.369331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ceb9cae8-ba02-478c-9f5a-4a970775cd7b None None] MFA Rules not processed for user `169dcec2e4364088b4cd4adb74d5f17c`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:19.370727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ceb9cae8-ba02-478c-9f5a-4a970775cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:19.376885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcd437-df48-4191-b8fc-337a23e97add admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:19.385229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf847a-8d1b-48bb-bfcc-2550e328abed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:19.386371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf847a-8d1b-48bb-bfcc-2550e328abed admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.386787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf847a-8d1b-48bb-bfcc-2550e328abed admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.387216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf847a-8d1b-48bb-bfcc-2550e328abed admin admin] PATH_INFO: `/v3/projects/19e5d438c83d4778a0d03171cc0150fc/users/fb01e44bd5ba4e0d8d44257d26369165/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.414244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf847a-8d1b-48bb-bfcc-2550e328abed admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e5d438c83d4778a0d03171cc0150fc, user_id=fb01e44bd5ba4e0d8d44257d26369165, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:19.417094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf847a-8d1b-48bb-bfcc-2550e328abed admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.431668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:19.478098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 900/1817] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:19.479021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9cae8-ba02-478c-9f5a-4a970775cd7b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:19.504427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 918/1818] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:19 2022] PUT /identity/v3/projects/19e5d438c83d4778a0d03171cc0150fc/users/fb01e44bd5ba4e0d8d44257d26369165/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:19.504677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9cae8-ba02-478c-9f5a-4a970775cd7b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:19.504775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf847a-8d1b-48bb-bfcc-2550e328abed admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:19.573488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ba0d2-31a6-4ff3-a720-01d10c3bf072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:19.574402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ba0d2-31a6-4ff3-a720-01d10c3bf072 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.574686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ba0d2-31a6-4ff3-a720-01d10c3bf072 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.574966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ba0d2-31a6-4ff3-a720-01d10c3bf072 admin admin] PATH_INFO: `/v3/projects/0f31e839793d40bb8d87f115cad7316b/users/5c4c78e0e47447a986166b25da0903e2/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.577139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ba0d2-31a6-4ff3-a720-01d10c3bf072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f31e839793d40bb8d87f115cad7316b, user_id=5c4c78e0e47447a986166b25da0903e2, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:19.579968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ba0d2-31a6-4ff3-a720-01d10c3bf072 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.586886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf847a-8d1b-48bb-bfcc-2550e328abed admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:19.601585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 901/1819] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:19 2022] PUT /identity/v3/projects/0f31e839793d40bb8d87f115cad7316b/users/5c4c78e0e47447a986166b25da0903e2/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:19.601585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ba0d2-31a6-4ff3-a720-01d10c3bf072 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:19.706005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2f992-e642-4c5c-b22e-0cbcdc0ccd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:19.706005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2f992-e642-4c5c-b22e-0cbcdc0ccd93 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.706005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2f992-e642-4c5c-b22e-0cbcdc0ccd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.706005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2f992-e642-4c5c-b22e-0cbcdc0ccd93 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.706698 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2f992-e642-4c5c-b22e-0cbcdc0ccd93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:19.706698 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2f992-e642-4c5c-b22e-0cbcdc0ccd93 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.706854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ba0d2-31a6-4ff3-a720-01d10c3bf072 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:19.706854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d760f-3196-41b5-8887-46808348df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:19.706854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d760f-3196-41b5-8887-46808348df69 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.706854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d760f-3196-41b5-8887-46808348df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.707163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d760f-3196-41b5-8887-46808348df69 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.707163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d760f-3196-41b5-8887-46808348df69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:19.707163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d760f-3196-41b5-8887-46808348df69 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.707163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 902/1820] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:19.707163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0187cf-91fd-4e44-8e3c-0a9bcea7503a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.707163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0187cf-91fd-4e44-8e3c-0a9bcea7503a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.707621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0187cf-91fd-4e44-8e3c-0a9bcea7503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.733724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-7b0187cf-91fd-4e44-8e3c-0a9bcea7503a None None] MFA Rules not processed for user `5c4c78e0e47447a986166b25da0903e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:19.735039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-7b0187cf-91fd-4e44-8e3c-0a9bcea7503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:19.812719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 903/1821] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:19.813870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0187cf-91fd-4e44-8e3c-0a9bcea7503a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:19.824307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0187cf-91fd-4e44-8e3c-0a9bcea7503a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:19.828868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43712bd6-17f9-4cf6-a552-95357de7f2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:19.829738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712bd6-17f9-4cf6-a552-95357de7f2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.830021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712bd6-17f9-4cf6-a552-95357de7f2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.830294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712bd6-17f9-4cf6-a552-95357de7f2f1 admin admin] PATH_INFO: `/v3/projects/19e5d438c83d4778a0d03171cc0150fc/users/fb01e44bd5ba4e0d8d44257d26369165/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.832298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43712bd6-17f9-4cf6-a552-95357de7f2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e5d438c83d4778a0d03171cc0150fc, user_id=fb01e44bd5ba4e0d8d44257d26369165, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:19.835616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43712bd6-17f9-4cf6-a552-95357de7f2f1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.845684 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 904/1822] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:19 2022] PUT /identity/v3/projects/19e5d438c83d4778a0d03171cc0150fc/users/fb01e44bd5ba4e0d8d44257d26369165/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:19.846457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43712bd6-17f9-4cf6-a552-95357de7f2f1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:19.908901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43712bd6-17f9-4cf6-a552-95357de7f2f1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:19.912484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3dd44-7871-4abc-bc6f-d168fb76ce1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:19.913225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3dd44-7871-4abc-bc6f-d168fb76ce1b service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.913503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3dd44-7871-4abc-bc6f-d168fb76ce1b service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.913782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3dd44-7871-4abc-bc6f-d168fb76ce1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:19.973918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3dd44-7871-4abc-bc6f-d168fb76ce1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:19.975362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3dd44-7871-4abc-bc6f-d168fb76ce1b service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:19.985470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 905/1823] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:19.986618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5f216-eee0-4367-9861-f5353d1b930c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:19.987147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5f216-eee0-4367-9861-f5353d1b930c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:19.987457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5f216-eee0-4367-9861-f5353d1b930c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:20.015838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f8f5f216-eee0-4367-9861-f5353d1b930c None None] MFA Rules not processed for user `fb01e44bd5ba4e0d8d44257d26369165`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:20.017052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f8f5f216-eee0-4367-9861-f5353d1b930c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:20.086802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 906/1824] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:20.737423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 919/1825] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:19 2022] POST /identity/v3/projects => generated 365 bytes in 1240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:20.738845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5f216-eee0-4367-9861-f5353d1b930c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:20.827743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5f216-eee0-4367-9861-f5353d1b930c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:20.838132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2f992-e642-4c5c-b22e-0cbcdc0ccd93 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:20.907022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe94f4-cca2-4a53-a598-e7b947ecf48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:20.907751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe94f4-cca2-4a53-a598-e7b947ecf48d admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:20.908038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe94f4-cca2-4a53-a598-e7b947ecf48d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:20.908313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe94f4-cca2-4a53-a598-e7b947ecf48d admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:20.909022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe94f4-cca2-4a53-a598-e7b947ecf48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:20.910934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe94f4-cca2-4a53-a598-e7b947ecf48d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:20.921202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2f992-e642-4c5c-b22e-0cbcdc0ccd93 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:20.924940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00073dfd-eaf6-4ce8-8e95-6d381fb16419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:20.925588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00073dfd-eaf6-4ce8-8e95-6d381fb16419 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:20.925872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00073dfd-eaf6-4ce8-8e95-6d381fb16419 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:20.926148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00073dfd-eaf6-4ce8-8e95-6d381fb16419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:20.983688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00073dfd-eaf6-4ce8-8e95-6d381fb16419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:20.985273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00073dfd-eaf6-4ce8-8e95-6d381fb16419 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:20.997015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 920/1826] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:21.045970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 907/1827] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:20 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:21.049361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00073dfd-eaf6-4ce8-8e95-6d381fb16419 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:21.061606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00073dfd-eaf6-4ce8-8e95-6d381fb16419 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:21.066871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35621288-89cd-4822-9a7c-58c51b697b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:21.067572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35621288-89cd-4822-9a7c-58c51b697b72 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:21.069104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35621288-89cd-4822-9a7c-58c51b697b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:21.069104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35621288-89cd-4822-9a7c-58c51b697b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:21.069409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35621288-89cd-4822-9a7c-58c51b697b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:21.071031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35621288-89cd-4822-9a7c-58c51b697b72 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:21.085934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 921/1828] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:21.087341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe94f4-cca2-4a53-a598-e7b947ecf48d admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:21.097674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe94f4-cca2-4a53-a598-e7b947ecf48d admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:21.102223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ebb21-a76e-4511-8600-13147fd12acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:21.103101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ebb21-a76e-4511-8600-13147fd12acb admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:21.103401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ebb21-a76e-4511-8600-13147fd12acb admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:21.103678 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ebb21-a76e-4511-8600-13147fd12acb admin admin] PATH_INFO: `/v3/projects/fb5100c8ea2b4e829b04e6a4eb4fe53d/users/8dd5979fba6d492c9f019f88f824bb36/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:21.119895 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ebb21-a76e-4511-8600-13147fd12acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5100c8ea2b4e829b04e6a4eb4fe53d, user_id=8dd5979fba6d492c9f019f88f824bb36, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:21.122744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ebb21-a76e-4511-8600-13147fd12acb admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:21.215275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 908/1829] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:21 2022] PUT /identity/v3/projects/fb5100c8ea2b4e829b04e6a4eb4fe53d/users/8dd5979fba6d492c9f019f88f824bb36/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:21.220156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35621288-89cd-4822-9a7c-58c51b697b72 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:21.229754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35621288-89cd-4822-9a7c-58c51b697b72 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:21.292197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2ed79-cd5d-4a5a-b370-27b8e15b12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:21.292874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ed79-cd5d-4a5a-b370-27b8e15b12a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:21.293152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ed79-cd5d-4a5a-b370-27b8e15b12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:21.293437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2ed79-cd5d-4a5a-b370-27b8e15b12a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:21.294529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2ed79-cd5d-4a5a-b370-27b8e15b12a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:21.296214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2ed79-cd5d-4a5a-b370-27b8e15b12a8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:21.310798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 922/1830] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:21.312111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ebb21-a76e-4511-8600-13147fd12acb admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:21.331265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ebb21-a76e-4511-8600-13147fd12acb admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:21.342021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd337fee-0dd9-4099-8177-7dc4530f8235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:21.342345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2ed79-cd5d-4a5a-b370-27b8e15b12a8 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:21.343017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd337fee-0dd9-4099-8177-7dc4530f8235 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:21.343309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd337fee-0dd9-4099-8177-7dc4530f8235 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:21.343617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd337fee-0dd9-4099-8177-7dc4530f8235 admin admin] PATH_INFO: `/v3/projects/fb5100c8ea2b4e829b04e6a4eb4fe53d/users/8dd5979fba6d492c9f019f88f824bb36/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:21.346067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd337fee-0dd9-4099-8177-7dc4530f8235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5100c8ea2b4e829b04e6a4eb4fe53d, user_id=8dd5979fba6d492c9f019f88f824bb36, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:21.352072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd337fee-0dd9-4099-8177-7dc4530f8235 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:21.360883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 909/1831] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:21 2022] PUT /identity/v3/projects/fb5100c8ea2b4e829b04e6a4eb4fe53d/users/8dd5979fba6d492c9f019f88f824bb36/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:21.370314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:21.372070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cdb41-62d5-494d-bcdb-ddcffd1cb662 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:21.372355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cdb41-62d5-494d-bcdb-ddcffd1cb662 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:21.372633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cdb41-62d5-494d-bcdb-ddcffd1cb662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:21.401553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-cf0cdb41-62d5-494d-bcdb-ddcffd1cb662 None None] MFA Rules not processed for user `8dd5979fba6d492c9f019f88f824bb36`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:21.402946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-cf0cdb41-62d5-494d-bcdb-ddcffd1cb662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:21.415872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2ed79-cd5d-4a5a-b370-27b8e15b12a8 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:21.495257 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf873-cf95-4464-8827-87598d3f63ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:21.495992 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf873-cf95-4464-8827-87598d3f63ae service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:21.496534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf873-cf95-4464-8827-87598d3f63ae service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:21.496658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 910/1832] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:21.496757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf873-cf95-4464-8827-87598d3f63ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:21.498505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-210cf873-cf95-4464-8827-87598d3f63ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:21.560705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cf873-cf95-4464-8827-87598d3f63ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:21.562396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cf873-cf95-4464-8827-87598d3f63ae service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:21.574929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 923/1833] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:21.776461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:21.835981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cdb41-62d5-494d-bcdb-ddcffd1cb662 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:21.846885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cdb41-62d5-494d-bcdb-ddcffd1cb662 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:21.851488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0519e2-c990-42d1-8563-a2fbaf3f94be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:21.852210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0519e2-c990-42d1-8563-a2fbaf3f94be service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:21.852651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0519e2-c990-42d1-8563-a2fbaf3f94be service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:21.852998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0519e2-c990-42d1-8563-a2fbaf3f94be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:21.862158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:21.864667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0519e2-c990-42d1-8563-a2fbaf3f94be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:21.866870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0519e2-c990-42d1-8563-a2fbaf3f94be service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:21.876824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 911/1834] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:22.349314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf873-cf95-4464-8827-87598d3f63ae service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:22.356505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf873-cf95-4464-8827-87598d3f63ae service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:22.361645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a09dc8-d176-47cc-b13b-d33b6c1cdfb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:22.362547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a09dc8-d176-47cc-b13b-d33b6c1cdfb1 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:22.363599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a09dc8-d176-47cc-b13b-d33b6c1cdfb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:22.363712 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a09dc8-d176-47cc-b13b-d33b6c1cdfb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:22.424760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a09dc8-d176-47cc-b13b-d33b6c1cdfb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:22.426162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a09dc8-d176-47cc-b13b-d33b6c1cdfb1 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:22.435882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 924/1835] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:23.123354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:24.305984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:24.970088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:25.061531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:25.777856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f71480-4002-4451-94a5-b289742a41df None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.778466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f71480-4002-4451-94a5-b289742a41df None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.778466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f71480-4002-4451-94a5-b289742a41df None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.780102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 912/1836] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:52:25.805720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a414d-8adb-474e-966b-0270df48f779 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.806345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a414d-8adb-474e-966b-0270df48f779 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.806740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a414d-8adb-474e-966b-0270df48f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:25.828829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a63a414d-8adb-474e-966b-0270df48f779 None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:25.830254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a63a414d-8adb-474e-966b-0270df48f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:25.925178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 925/1837] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:52:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:25.949076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f71480-4002-4451-94a5-b289742a41df None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:25.950862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-15f71480-4002-4451-94a5-b289742a41df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:25.974745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f71480-4002-4451-94a5-b289742a41df None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:25.991285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11aa17-f344-4f63-b0c2-832f4c4573b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:25.991285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11aa17-f344-4f63-b0c2-832f4c4573b7 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:25.991285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11aa17-f344-4f63-b0c2-832f4c4573b7 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:25.991285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11aa17-f344-4f63-b0c2-832f4c4573b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:26.002400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11aa17-f344-4f63-b0c2-832f4c4573b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:26.004450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11aa17-f344-4f63-b0c2-832f4c4573b7 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:26.026782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 913/1838] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:26.295870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:26.484489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.092699 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.191276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.626787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.712952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.827242 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.913704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:27.941681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:28.049712 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:28.291238 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:28.495324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a414d-8adb-474e-966b-0270df48f779 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:28.571277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a414d-8adb-474e-966b-0270df48f779 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:28.576332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:28.577218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:28.581752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:28.581752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] PATH_INFO: `/v3/users/169dcec2e4364088b4cd4adb74d5f17c` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:28.581752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=169dcec2e4364088b4cd4adb74d5f17c)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:28.581989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:28.804720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:28.864070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169dcec2e4364088b4cd4adb74d5f17c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:28.877538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169dcec2e4364088b4cd4adb74d5f17c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:28.974610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169dcec2e4364088b4cd4adb74d5f17c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:28.982434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169dcec2e4364088b4cd4adb74d5f17c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:28.983185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169dcec2e4364088b4cd4adb74d5f17c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:28.989515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 926/1839] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:28 2022] DELETE /identity/v3/users/169dcec2e4364088b4cd4adb74d5f17c => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:28.994505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb682e-7589-4743-b2db-8ba7233c7a4a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:28.994794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb682e-7589-4743-b2db-8ba7233c7a4a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:28.995091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb682e-7589-4743-b2db-8ba7233c7a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:29.013505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-0ecb682e-7589-4743-b2db-8ba7233c7a4a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:29.014728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0ecb682e-7589-4743-b2db-8ba7233c7a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:29.067040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:29.077338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 914/1840] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:29.087040 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:29.088589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:29.152870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478362d-81c6-45fd-a940-55c982908ebf admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:29.157736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de28ce0-9dcf-4133-bea6-57c3637d5329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:29.158396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de28ce0-9dcf-4133-bea6-57c3637d5329 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:29.158681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de28ce0-9dcf-4133-bea6-57c3637d5329 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:29.158961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de28ce0-9dcf-4133-bea6-57c3637d5329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:29.162029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb682e-7589-4743-b2db-8ba7233c7a4a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:29.164175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0ecb682e-7589-4743-b2db-8ba7233c7a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:29.170048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de28ce0-9dcf-4133-bea6-57c3637d5329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:29.171703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de28ce0-9dcf-4133-bea6-57c3637d5329 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:29.191486 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 927/1841] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:29.230408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb682e-7589-4743-b2db-8ba7233c7a4a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:29.238038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369631f-3437-4fe4-b19b-83cd02006995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:29.238706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369631f-3437-4fe4-b19b-83cd02006995 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:29.238991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369631f-3437-4fe4-b19b-83cd02006995 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:29.239269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369631f-3437-4fe4-b19b-83cd02006995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:29.241982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3369631f-3437-4fe4-b19b-83cd02006995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:29.310803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369631f-3437-4fe4-b19b-83cd02006995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:29.312275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369631f-3437-4fe4-b19b-83cd02006995 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:29.322077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 915/1842] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:29.569727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:29.657387 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de28ce0-9dcf-4133-bea6-57c3637d5329 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:29.659165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7de28ce0-9dcf-4133-bea6-57c3637d5329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:29.674971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de28ce0-9dcf-4133-bea6-57c3637d5329 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:29.681197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:29.688101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:29.688101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:29.688101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] PATH_INFO: `/v3/projects/ab38778feedf41c29363ded88e587908` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:29.688101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab38778feedf41c29363ded88e587908)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:29.690618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:29.846744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab38778feedf41c29363ded88e587908', 'request_id': 'req-b44dafd6-9ce7-47c6-878e-9db825c24bb8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:29.856855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab38778feedf41c29363ded88e587908', 'request_id': 'req-b44dafd6-9ce7-47c6-878e-9db825c24bb8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:29.867612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab38778feedf41c29363ded88e587908', 'request_id': 'req-b44dafd6-9ce7-47c6-878e-9db825c24bb8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:29.867880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369631f-3437-4fe4-b19b-83cd02006995 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:29.868216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3369631f-3437-4fe4-b19b-83cd02006995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:29.882525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369631f-3437-4fe4-b19b-83cd02006995 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:29.937338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] The token cache is being invalidate because project ab38778feedf41c29363ded88e587908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:29.938766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:29.939684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:29.942317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 928/1843] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:29 2022] DELETE /identity/v3/projects/ab38778feedf41c29363ded88e587908 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:29.950219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:29.953404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:29.954781 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:29.954868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:29.955140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] PATH_INFO: `/v3/users/b05e1f5d2346429f993f504451c6af09` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:29.956716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05e1f5d2346429f993f504451c6af09)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:29.959085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:29.964503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:29.997894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dafd6-9ce7-47c6-878e-9db825c24bb8 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:30.005142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:30.006037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:30.006314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:30.006595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] PATH_INFO: `/v3/users/8dd5979fba6d492c9f019f88f824bb36` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:30.015008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd5979fba6d492c9f019f88f824bb36)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:30.017401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:30.142104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:30.252640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd5979fba6d492c9f019f88f824bb36'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:30.262802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05e1f5d2346429f993f504451c6af09'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:30.265960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:30.271848 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05e1f5d2346429f993f504451c6af09'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:30.278215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd5979fba6d492c9f019f88f824bb36'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:30.369002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05e1f5d2346429f993f504451c6af09'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:30.369610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05e1f5d2346429f993f504451c6af09'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:30.370211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f4b666d-03d2-4482-b372-837000443d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05e1f5d2346429f993f504451c6af09'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:30.388610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 916/1844] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:29 2022] DELETE /identity/v3/users/b05e1f5d2346429f993f504451c6af09 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:30.397362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131c678-16f0-484f-9776-43a9d17c147c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:30.397665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131c678-16f0-484f-9776-43a9d17c147c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:30.397948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131c678-16f0-484f-9776-43a9d17c147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:30.415711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-e131c678-16f0-484f-9776-43a9d17c147c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:30.416847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e131c678-16f0-484f-9776-43a9d17c147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:30.458432 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd5979fba6d492c9f019f88f824bb36'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:30.465811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd5979fba6d492c9f019f88f824bb36'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:30.466649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd5979fba6d492c9f019f88f824bb36'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:30.490224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 929/1845] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:29 2022] DELETE /identity/v3/users/8dd5979fba6d492c9f019f88f824bb36 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:30.532454 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 917/1846] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:30.532959 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:30.544682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:30.546983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:30.625815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799cada-5c53-43c3-beda-ca40d2bef889 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:30.630658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306bbe-0790-4905-b680-ce6ba3ed690f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:30.631612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306bbe-0790-4905-b680-ce6ba3ed690f service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:30.631964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306bbe-0790-4905-b680-ce6ba3ed690f service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:30.632352 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306bbe-0790-4905-b680-ce6ba3ed690f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:30.712670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab306bbe-0790-4905-b680-ce6ba3ed690f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:30.714229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab306bbe-0790-4905-b680-ce6ba3ed690f service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:30.726295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 930/1847] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:30.811391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:31.190154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131c678-16f0-484f-9776-43a9d17c147c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:31.192309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e131c678-16f0-484f-9776-43a9d17c147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:31.209763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131c678-16f0-484f-9776-43a9d17c147c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:31.226730 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:31.228904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:31.229320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:31.229734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] PATH_INFO: `/v3/projects/fb5100c8ea2b4e829b04e6a4eb4fe53d` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:31.232155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5100c8ea2b4e829b04e6a4eb4fe53d)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:31.234369 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:31.399586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5100c8ea2b4e829b04e6a4eb4fe53d', 'request_id': 'req-d7a647de-6049-4c9e-bdf8-ff25134f346b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:31.407274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5100c8ea2b4e829b04e6a4eb4fe53d', 'request_id': 'req-d7a647de-6049-4c9e-bdf8-ff25134f346b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:31.412419 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306bbe-0790-4905-b680-ce6ba3ed690f service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:31.415370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ab306bbe-0790-4905-b680-ce6ba3ed690f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:31.422201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5100c8ea2b4e829b04e6a4eb4fe53d', 'request_id': 'req-d7a647de-6049-4c9e-bdf8-ff25134f346b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:31.456048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306bbe-0790-4905-b680-ce6ba3ed690f service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:31.521970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:31.522921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:31.523299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:31.525942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] PATH_INFO: `/v3/projects/8af9779d5d82490788251b8cb8d3a5cc` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:31.525942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af9779d5d82490788251b8cb8d3a5cc)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:31.527938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:31.530552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] The token cache is being invalidate because project fb5100c8ea2b4e829b04e6a4eb4fe53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:31.531052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:31.531695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7a647de-6049-4c9e-bdf8-ff25134f346b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:31.533376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 918/1848] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:31 2022] DELETE /identity/v3/projects/fb5100c8ea2b4e829b04e6a4eb4fe53d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:31.538177 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542ca4-86a6-47a3-9315-8260580dd8a8 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:31.538468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542ca4-86a6-47a3-9315-8260580dd8a8 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:31.538752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542ca4-86a6-47a3-9315-8260580dd8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:31.558268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-0e542ca4-86a6-47a3-9315-8260580dd8a8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:31.559539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0e542ca4-86a6-47a3-9315-8260580dd8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:31.568216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 919/1849] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:31.584176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a414-6925-4519-a2df-80f3f17eb8c6 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:31.584652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a414-6925-4519-a2df-80f3f17eb8c6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:31.584939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00a414-6925-4519-a2df-80f3f17eb8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:31.604088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-3e00a414-6925-4519-a2df-80f3f17eb8c6 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:31.611150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3e00a414-6925-4519-a2df-80f3f17eb8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:31.616978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 920/1850] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:31.621628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a414-6925-4519-a2df-80f3f17eb8c6 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:31.632483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00a414-6925-4519-a2df-80f3f17eb8c6 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:31.646585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf4b90-cb37-4a16-b2a0-e1f07c7bde4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:31.646585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf4b90-cb37-4a16-b2a0-e1f07c7bde4a admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:31.646585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf4b90-cb37-4a16-b2a0-e1f07c7bde4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:31.646585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf4b90-cb37-4a16-b2a0-e1f07c7bde4a admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:31.646975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf4b90-cb37-4a16-b2a0-e1f07c7bde4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:31.648130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf4b90-cb37-4a16-b2a0-e1f07c7bde4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:31.651267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf4b90-cb37-4a16-b2a0-e1f07c7bde4a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:31.668765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 921/1851] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:52:31.669786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf4b90-cb37-4a16-b2a0-e1f07c7bde4a admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:31.674295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af9779d5d82490788251b8cb8d3a5cc', 'request_id': 'req-cf5f175c-3a87-4461-9811-e5108754597a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:31.679675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf4b90-cb37-4a16-b2a0-e1f07c7bde4a admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:31.681757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af9779d5d82490788251b8cb8d3a5cc', 'request_id': 'req-cf5f175c-3a87-4461-9811-e5108754597a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:31.687809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af9779d5d82490788251b8cb8d3a5cc', 'request_id': 'req-cf5f175c-3a87-4461-9811-e5108754597a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:31.701392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:31.737308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb68d6-ef90-48cf-9eb1-4e8da508d50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:31.738011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb68d6-ef90-48cf-9eb1-4e8da508d50c admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:31.738292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb68d6-ef90-48cf-9eb1-4e8da508d50c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:31.738571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb68d6-ef90-48cf-9eb1-4e8da508d50c admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:31.739286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb68d6-ef90-48cf-9eb1-4e8da508d50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:31.741213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb68d6-ef90-48cf-9eb1-4e8da508d50c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:31.791924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] The token cache is being invalidate because project 8af9779d5d82490788251b8cb8d3a5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:31.792139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:31.792766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:31.794327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 931/1852] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:31 2022] DELETE /identity/v3/projects/8af9779d5d82490788251b8cb8d3a5cc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:31.798286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:31.799638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:31.812154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f175c-3a87-4461-9811-e5108754597a admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:31.816863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:31.817883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:31.818260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:31.818590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] PATH_INFO: `/v3/users/55056ac51bca4d3aafb071447f0accae` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:31.819780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55056ac51bca4d3aafb071447f0accae)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:31.822716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:31.873473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 922/1853] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:31 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:31.878372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb68d6-ef90-48cf-9eb1-4e8da508d50c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:31.880017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-18cb68d6-ef90-48cf-9eb1-4e8da508d50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:31.944800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb68d6-ef90-48cf-9eb1-4e8da508d50c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:31.950900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818859ff-8d4c-4bc4-b9d1-6861ecadd0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:31.951615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818859ff-8d4c-4bc4-b9d1-6861ecadd0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:31.952021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818859ff-8d4c-4bc4-b9d1-6861ecadd0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:31.952318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818859ff-8d4c-4bc4-b9d1-6861ecadd0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:31.953137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818859ff-8d4c-4bc4-b9d1-6861ecadd0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:31.961722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818859ff-8d4c-4bc4-b9d1-6861ecadd0e3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:31.987396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:32.052596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55056ac51bca4d3aafb071447f0accae'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:32.066316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55056ac51bca4d3aafb071447f0accae'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:32.068434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 923/1854] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:31 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:32.072422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818859ff-8d4c-4bc4-b9d1-6861ecadd0e3 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:32.082602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818859ff-8d4c-4bc4-b9d1-6861ecadd0e3 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:32.090608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3f684-e365-43e5-880b-5fb073338c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:32.090608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3f684-e365-43e5-880b-5fb073338c0b admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:32.090608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3f684-e365-43e5-880b-5fb073338c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:32.090608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3f684-e365-43e5-880b-5fb073338c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:32.090945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3f684-e365-43e5-880b-5fb073338c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:32.091862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3f684-e365-43e5-880b-5fb073338c0b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:32.102254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 924/1855] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:32.106732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3f684-e365-43e5-880b-5fb073338c0b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:32.117268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3f684-e365-43e5-880b-5fb073338c0b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:32.122507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b17117-70c7-4e72-9957-e7da46258136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:32.123164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b17117-70c7-4e72-9957-e7da46258136 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:32.123482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b17117-70c7-4e72-9957-e7da46258136 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:32.123765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b17117-70c7-4e72-9957-e7da46258136 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:32.124470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b17117-70c7-4e72-9957-e7da46258136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:32.126055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b17117-70c7-4e72-9957-e7da46258136 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:32.130463 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55056ac51bca4d3aafb071447f0accae'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:32.138362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 925/1856] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:32.139311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55056ac51bca4d3aafb071447f0accae'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:32.140336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1030c1b5-6310-4ae1-b703-467a0c688e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55056ac51bca4d3aafb071447f0accae'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:32.144282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b17117-70c7-4e72-9957-e7da46258136 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:32.146045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b2b17117-70c7-4e72-9957-e7da46258136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:32.148319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 932/1857] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:31 2022] DELETE /identity/v3/users/55056ac51bca4d3aafb071447f0accae => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:32.162607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b17117-70c7-4e72-9957-e7da46258136 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:32.222070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0deb08-161a-46b7-92aa-8617a5c68af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:32.222966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0deb08-161a-46b7-92aa-8617a5c68af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:32.223283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0deb08-161a-46b7-92aa-8617a5c68af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:32.223591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0deb08-161a-46b7-92aa-8617a5c68af5 admin admin] PATH_INFO: `/v3/projects/afdeaa51d95f42a787370da4514d26c7/users/a517c803ec9a4442b229a90bdb40bbfc/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:32.239899 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0deb08-161a-46b7-92aa-8617a5c68af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afdeaa51d95f42a787370da4514d26c7, user_id=a517c803ec9a4442b229a90bdb40bbfc, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:32.242616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0deb08-161a-46b7-92aa-8617a5c68af5 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:32.341272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 926/1858] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:32 2022] PUT /identity/v3/projects/afdeaa51d95f42a787370da4514d26c7/users/a517c803ec9a4442b229a90bdb40bbfc/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:32.351241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b863ae-f414-450c-9970-0107a726f4f2 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:32.351602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b863ae-f414-450c-9970-0107a726f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:32.351917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b863ae-f414-450c-9970-0107a726f4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:32.384660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b4b863ae-f414-450c-9970-0107a726f4f2 None None] MFA Rules not processed for user `a517c803ec9a4442b229a90bdb40bbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:32.385974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b4b863ae-f414-450c-9970-0107a726f4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:32.458928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 933/1859] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:32.463501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0deb08-161a-46b7-92aa-8617a5c68af5 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:32.555467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0deb08-161a-46b7-92aa-8617a5c68af5 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:32.561720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0b042-784c-4d92-ac9b-0b2175909eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:32.562519 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0b042-784c-4d92-ac9b-0b2175909eee admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:32.562934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0b042-784c-4d92-ac9b-0b2175909eee admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:32.563670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0b042-784c-4d92-ac9b-0b2175909eee admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:32.564145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0b042-784c-4d92-ac9b-0b2175909eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:32.566237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0b042-784c-4d92-ac9b-0b2175909eee admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:32.717622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 927/1860] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:32 2022] POST /identity/v3/projects => generated 381 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:32.720504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b863ae-f414-450c-9970-0107a726f4f2 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:32.734331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b863ae-f414-450c-9970-0107a726f4f2 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:32.745483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0b042-784c-4d92-ac9b-0b2175909eee admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:32.747712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-dcc0b042-784c-4d92-ac9b-0b2175909eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:32.800042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b08c9-479e-4528-a10c-c4f336ed5b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:32.800734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b08c9-479e-4528-a10c-c4f336ed5b5f admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:32.801018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b08c9-479e-4528-a10c-c4f336ed5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:32.801297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b08c9-479e-4528-a10c-c4f336ed5b5f admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:32.801994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b08c9-479e-4528-a10c-c4f336ed5b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:32.804136 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b08c9-479e-4528-a10c-c4f336ed5b5f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:32.816802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0b042-784c-4d92-ac9b-0b2175909eee admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:32.822068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:32.823013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:32.823447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:32.823731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] PATH_INFO: `/v3/projects/34c393f1558048d191fceb72b7559e02` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:32.824963 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c393f1558048d191fceb72b7559e02)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:32.826917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:32.834907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:32.965175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 934/1861] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:32 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:32.969018 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b08c9-479e-4528-a10c-c4f336ed5b5f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:32.977039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c393f1558048d191fceb72b7559e02', 'request_id': 'req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:32.978813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b08c9-479e-4528-a10c-c4f336ed5b5f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:32.983717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c393f1558048d191fceb72b7559e02', 'request_id': 'req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:32.989402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c393f1558048d191fceb72b7559e02', 'request_id': 'req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:33.047428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9d47e-3b4b-4099-b39a-58964b174319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.048177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9d47e-3b4b-4099-b39a-58964b174319 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.048624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9d47e-3b4b-4099-b39a-58964b174319 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.048904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9d47e-3b4b-4099-b39a-58964b174319 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.049637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9d47e-3b4b-4099-b39a-58964b174319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.051304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9d47e-3b4b-4099-b39a-58964b174319 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.062566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 935/1862] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:33.067057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9d47e-3b4b-4099-b39a-58964b174319 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:33.076804 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9d47e-3b4b-4099-b39a-58964b174319 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:33.081485 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfa7e2-8ded-45c0-9633-1d61ecf6c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.082340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfa7e2-8ded-45c0-9633-1d61ecf6c17f admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.082618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfa7e2-8ded-45c0-9633-1d61ecf6c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.082891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfa7e2-8ded-45c0-9633-1d61ecf6c17f admin admin] PATH_INFO: `/v3/projects/f2a7af6e525e4626959b7512e792441d/users/47310027f0794a0c89ea0a2b08d3153c/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.087994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] The token cache is being invalidate because project 34c393f1558048d191fceb72b7559e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:33.088283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:33.088928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5f7fc1d7-5b15-4bb5-bec5-8f2794c1f2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:33.090537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 928/1863] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:32 2022] DELETE /identity/v3/projects/34c393f1558048d191fceb72b7559e02 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:33.096342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:33.099893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfa7e2-8ded-45c0-9633-1d61ecf6c17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a7af6e525e4626959b7512e792441d, user_id=47310027f0794a0c89ea0a2b08d3153c, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.101517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089169b-408c-43e6-9964-12686bccaae7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.101870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089169b-408c-43e6-9964-12686bccaae7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.102217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089169b-408c-43e6-9964-12686bccaae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.103066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfa7e2-8ded-45c0-9633-1d61ecf6c17f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.122516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-7089169b-408c-43e6-9964-12686bccaae7 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:33.123639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-7089169b-408c-43e6-9964-12686bccaae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:33.132207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 929/1864] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:33.143485 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5021-a4d3-48de-9cab-944d794ba7c6 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.143826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5021-a4d3-48de-9cab-944d794ba7c6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.144183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5021-a4d3-48de-9cab-944d794ba7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.162922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b53e5021-a4d3-48de-9cab-944d794ba7c6 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:33.164161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b53e5021-a4d3-48de-9cab-944d794ba7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:33.173188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 930/1865] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:33.179740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e5021-a4d3-48de-9cab-944d794ba7c6 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:33.189735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e5021-a4d3-48de-9cab-944d794ba7c6 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:33.194559 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7838-74a0-40a9-a9f7-858296cd8051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.195436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7838-74a0-40a9-a9f7-858296cd8051 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.195739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7838-74a0-40a9-a9f7-858296cd8051 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.196042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7838-74a0-40a9-a9f7-858296cd8051 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.196788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7838-74a0-40a9-a9f7-858296cd8051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:33.197091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7838-74a0-40a9-a9f7-858296cd8051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.198679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7838-74a0-40a9-a9f7-858296cd8051 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.212361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 931/1866] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:52:33.216517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7838-74a0-40a9-a9f7-858296cd8051 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:33.225792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7838-74a0-40a9-a9f7-858296cd8051 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:33.230875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fde94-d5f3-4832-821b-83f6ef51a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.231537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fde94-d5f3-4832-821b-83f6ef51a057 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.231819 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fde94-d5f3-4832-821b-83f6ef51a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.232093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fde94-d5f3-4832-821b-83f6ef51a057 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.232757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fde94-d5f3-4832-821b-83f6ef51a057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.234845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fde94-d5f3-4832-821b-83f6ef51a057 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.249786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 936/1867] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:33 2022] PUT /identity/v3/projects/f2a7af6e525e4626959b7512e792441d/users/47310027f0794a0c89ea0a2b08d3153c/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:33.261540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfa7e2-8ded-45c0-9633-1d61ecf6c17f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:33.263260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0ecfa7e2-8ded-45c0-9633-1d61ecf6c17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:33.329053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfa7e2-8ded-45c0-9633-1d61ecf6c17f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:33.334482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab4fc-a2e0-4475-b977-387481dcd2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.335154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab4fc-a2e0-4475-b977-387481dcd2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.335469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab4fc-a2e0-4475-b977-387481dcd2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.335753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ab4fc-a2e0-4475-b977-387481dcd2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.336484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ab4fc-a2e0-4475-b977-387481dcd2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.345015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ab4fc-a2e0-4475-b977-387481dcd2c4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.345145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 932/1868] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:33 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:33.345145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fde94-d5f3-4832-821b-83f6ef51a057 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:33.349710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 937/1869] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:33.354590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab4fc-a2e0-4475-b977-387481dcd2c4 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:33.364537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ab4fc-a2e0-4475-b977-387481dcd2c4 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:33.393325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:33.417162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fde94-d5f3-4832-821b-83f6ef51a057 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:33.422245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de10bef-648c-44c1-b19d-07f33b8a5247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.422953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de10bef-648c-44c1-b19d-07f33b8a5247 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.423242 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de10bef-648c-44c1-b19d-07f33b8a5247 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.423546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de10bef-648c-44c1-b19d-07f33b8a5247 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.424239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de10bef-648c-44c1-b19d-07f33b8a5247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.426240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de10bef-648c-44c1-b19d-07f33b8a5247 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.429887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92978d-b747-48dc-bba9-b85c656411b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.431220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92978d-b747-48dc-bba9-b85c656411b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.431850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92978d-b747-48dc-bba9-b85c656411b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.432299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92978d-b747-48dc-bba9-b85c656411b6 admin admin] PATH_INFO: `/v3/projects/f2a7af6e525e4626959b7512e792441d/users/47310027f0794a0c89ea0a2b08d3153c/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.437769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92978d-b747-48dc-bba9-b85c656411b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a7af6e525e4626959b7512e792441d, user_id=47310027f0794a0c89ea0a2b08d3153c, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.437995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92978d-b747-48dc-bba9-b85c656411b6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.456191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 938/1870] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:33 2022] PUT /identity/v3/projects/f2a7af6e525e4626959b7512e792441d/users/47310027f0794a0c89ea0a2b08d3153c/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:33.460978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35678fe-10fc-4539-b154-6223549dd2c8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.463803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35678fe-10fc-4539-b154-6223549dd2c8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.464096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35678fe-10fc-4539-b154-6223549dd2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.494686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b35678fe-10fc-4539-b154-6223549dd2c8 None None] MFA Rules not processed for user `47310027f0794a0c89ea0a2b08d3153c`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:33.496053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b35678fe-10fc-4539-b154-6223549dd2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:33.581984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 939/1871] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:33.596131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35678fe-10fc-4539-b154-6223549dd2c8 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:33.605116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 933/1872] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:33 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:33.606153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b35678fe-10fc-4539-b154-6223549dd2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:33.609125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de10bef-648c-44c1-b19d-07f33b8a5247 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:33.622481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de10bef-648c-44c1-b19d-07f33b8a5247 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:33.666949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35678fe-10fc-4539-b154-6223549dd2c8 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:33.670913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f3c33-dc64-465c-8feb-daedfa770d14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.671754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3c33-dc64-465c-8feb-daedfa770d14 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.672157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3c33-dc64-465c-8feb-daedfa770d14 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.672535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f3c33-dc64-465c-8feb-daedfa770d14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.686106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f3c33-dc64-465c-8feb-daedfa770d14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.687626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f3c33-dc64-465c-8feb-daedfa770d14 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.689258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c50c0-b430-4def-a76a-a2cc350ede82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.690194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c50c0-b430-4def-a76a-a2cc350ede82 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.690627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c50c0-b430-4def-a76a-a2cc350ede82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.691048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c50c0-b430-4def-a76a-a2cc350ede82 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.693868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c50c0-b430-4def-a76a-a2cc350ede82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.695825 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c50c0-b430-4def-a76a-a2cc350ede82 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.699198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 940/1873] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:33.713924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 934/1874] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:33.715283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f3c33-dc64-465c-8feb-daedfa770d14 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:33.737431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f3c33-dc64-465c-8feb-daedfa770d14 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:33.744713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb927c6a-d452-44e3-aa2a-fe10215b9df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.745447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927c6a-d452-44e3-aa2a-fe10215b9df5 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.745789 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927c6a-d452-44e3-aa2a-fe10215b9df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.746479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb927c6a-d452-44e3-aa2a-fe10215b9df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.747227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927c6a-d452-44e3-aa2a-fe10215b9df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.749245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb927c6a-d452-44e3-aa2a-fe10215b9df5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.765908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 941/1875] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:33.767318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c50c0-b430-4def-a76a-a2cc350ede82 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:33.778111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c50c0-b430-4def-a76a-a2cc350ede82 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:33.784072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b26e-f0ea-4d42-9473-66e759c2930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:33.785040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b26e-f0ea-4d42-9473-66e759c2930a admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.785661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b26e-f0ea-4d42-9473-66e759c2930a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.785931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b26e-f0ea-4d42-9473-66e759c2930a admin admin] PATH_INFO: `/v3/projects/a41f95c64ef0420da87d3f14c7758aa8/users/1d3d31e6933944dcbc251873d6083521/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.812254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296b26e-f0ea-4d42-9473-66e759c2930a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41f95c64ef0420da87d3f14c7758aa8, user_id=1d3d31e6933944dcbc251873d6083521, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:33.815336 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296b26e-f0ea-4d42-9473-66e759c2930a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:33.845871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:33.908110 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 935/1876] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:33 2022] PUT /identity/v3/projects/a41f95c64ef0420da87d3f14c7758aa8/users/1d3d31e6933944dcbc251873d6083521/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:33.919540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58958-9f38-4d1d-80bf-4cb2649066dc None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:33.919828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58958-9f38-4d1d-80bf-4cb2649066dc None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:33.920109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58958-9f38-4d1d-80bf-4cb2649066dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:33.956433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-2cc58958-9f38-4d1d-80bf-4cb2649066dc None None] MFA Rules not processed for user `1d3d31e6933944dcbc251873d6083521`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:33.958535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2cc58958-9f38-4d1d-80bf-4cb2649066dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:34.025463 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 942/1877] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:34.030120 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b26e-f0ea-4d42-9473-66e759c2930a admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:34.098075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b26e-f0ea-4d42-9473-66e759c2930a admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:34.104306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35a62c-bf2a-43cd-8fb5-319b707915dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:34.105037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35a62c-bf2a-43cd-8fb5-319b707915dd admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:34.105400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35a62c-bf2a-43cd-8fb5-319b707915dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:34.105674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35a62c-bf2a-43cd-8fb5-319b707915dd admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:34.106365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35a62c-bf2a-43cd-8fb5-319b707915dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:34.108486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35a62c-bf2a-43cd-8fb5-319b707915dd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:34.170037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:34.251246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 936/1878] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:34 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:34.255296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58958-9f38-4d1d-80bf-4cb2649066dc None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:34.267477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58958-9f38-4d1d-80bf-4cb2649066dc None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:34.328579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551905a-3f93-4208-8ce3-a93e65800ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:34.329253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551905a-3f93-4208-8ce3-a93e65800ced admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:34.329536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551905a-3f93-4208-8ce3-a93e65800ced admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:34.329815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551905a-3f93-4208-8ce3-a93e65800ced admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:34.330499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551905a-3f93-4208-8ce3-a93e65800ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:34.332455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551905a-3f93-4208-8ce3-a93e65800ced admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:34.336429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:34.541910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 943/1879] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:34 2022] POST /identity/v3/users => generated 298 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:34.545747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35a62c-bf2a-43cd-8fb5-319b707915dd admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:34.556948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35a62c-bf2a-43cd-8fb5-319b707915dd admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:34.563164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceec7d-4fd4-4fd3-a32e-8df6aada1c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:34.573738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceec7d-4fd4-4fd3-a32e-8df6aada1c64 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:34.573738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceec7d-4fd4-4fd3-a32e-8df6aada1c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:34.573738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceec7d-4fd4-4fd3-a32e-8df6aada1c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:34.573738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ceec7d-4fd4-4fd3-a32e-8df6aada1c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:34.573738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ceec7d-4fd4-4fd3-a32e-8df6aada1c64 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:34.583969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 937/1880] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:34.585146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551905a-3f93-4208-8ce3-a93e65800ced admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:34.596632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551905a-3f93-4208-8ce3-a93e65800ced admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:34.601678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b641a93-02d9-4dcf-814b-008e1be05709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:34.602927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b641a93-02d9-4dcf-814b-008e1be05709 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:34.603476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b641a93-02d9-4dcf-814b-008e1be05709 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:34.604159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b641a93-02d9-4dcf-814b-008e1be05709 admin admin] PATH_INFO: `/v3/projects/9fbaff083f314c508027a83d778dd125/users/ef17ef23b5bf426d86fd09d8d9991d50/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:34.621956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b641a93-02d9-4dcf-814b-008e1be05709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fbaff083f314c508027a83d778dd125, user_id=ef17ef23b5bf426d86fd09d8d9991d50, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:34.624714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b641a93-02d9-4dcf-814b-008e1be05709 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:34.701085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceec7d-4fd4-4fd3-a32e-8df6aada1c64 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:34.703764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-30ceec7d-4fd4-4fd3-a32e-8df6aada1c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:34.706186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 944/1881] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:34 2022] PUT /identity/v3/projects/9fbaff083f314c508027a83d778dd125/users/ef17ef23b5bf426d86fd09d8d9991d50/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:34.710123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b641a93-02d9-4dcf-814b-008e1be05709 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:34.720205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceec7d-4fd4-4fd3-a32e-8df6aada1c64 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:34.775918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b641a93-02d9-4dcf-814b-008e1be05709 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:34.781417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c584d1-1e0d-42fb-b738-3575208a21ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:34.782127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c584d1-1e0d-42fb-b738-3575208a21ed admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:34.782412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c584d1-1e0d-42fb-b738-3575208a21ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:34.782704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c584d1-1e0d-42fb-b738-3575208a21ed admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:34.783165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:34.783452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c584d1-1e0d-42fb-b738-3575208a21ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:34.784078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:34.784363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:34.784651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] PATH_INFO: `/v3/users/9e9980f1319b4256945a2d7fa326c8af` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:34.785845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9980f1319b4256945a2d7fa326c8af)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:34.788811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c584d1-1e0d-42fb-b738-3575208a21ed admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:34.788930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:34.799703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 945/1882] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:34.800679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c584d1-1e0d-42fb-b738-3575208a21ed admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:34.811200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c584d1-1e0d-42fb-b738-3575208a21ed admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:34.815553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:34.820515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0b64a-e690-4478-b679-f24545d15cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:34.821981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0b64a-e690-4478-b679-f24545d15cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:34.822266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0b64a-e690-4478-b679-f24545d15cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:34.822568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0b64a-e690-4478-b679-f24545d15cc5 admin admin] PATH_INFO: `/v3/projects/9fbaff083f314c508027a83d778dd125/users/ef17ef23b5bf426d86fd09d8d9991d50/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:34.824563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0b64a-e690-4478-b679-f24545d15cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fbaff083f314c508027a83d778dd125, user_id=ef17ef23b5bf426d86fd09d8d9991d50, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:34.827181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0b64a-e690-4478-b679-f24545d15cc5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:34.854715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 946/1883] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:34 2022] PUT /identity/v3/projects/9fbaff083f314c508027a83d778dd125/users/ef17ef23b5bf426d86fd09d8d9991d50/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:34.859548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c127df-b73c-4396-917e-f6d6fa05553d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:34.859848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c127df-b73c-4396-917e-f6d6fa05553d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:34.860199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c127df-b73c-4396-917e-f6d6fa05553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:34.902185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a4c127df-b73c-4396-917e-f6d6fa05553d None None] MFA Rules not processed for user `ef17ef23b5bf426d86fd09d8d9991d50`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:34.903431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a4c127df-b73c-4396-917e-f6d6fa05553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:34.980887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 947/1884] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:35.056981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c127df-b73c-4396-917e-f6d6fa05553d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:35.081003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9980f1319b4256945a2d7fa326c8af'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:35.088563 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9980f1319b4256945a2d7fa326c8af'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:35.120363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c127df-b73c-4396-917e-f6d6fa05553d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:35.125036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3fba6-0e31-4741-9f29-ed28e500f1b1 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47310027f0794a0c89ea0a2b08d3153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2a7af6e525e4626959b7512e792441d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:35.125725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3fba6-0e31-4741-9f29-ed28e500f1b1 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:35.126012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3fba6-0e31-4741-9f29-ed28e500f1b1 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:35.126288 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3fba6-0e31-4741-9f29-ed28e500f1b1 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:35.127046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3fba6-0e31-4741-9f29-ed28e500f1b1 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:35.127372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3fba6-0e31-4741-9f29-ed28e500f1b1 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:35.131870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3fba6-0e31-4741-9f29-ed28e500f1b1 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:35.141377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 948/1885] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:52:35.142413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3fba6-0e31-4741-9f29-ed28e500f1b1 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:35.144132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ffc3fba6-0e31-4741-9f29-ed28e500f1b1 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:35.186918 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9980f1319b4256945a2d7fa326c8af'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:35.187578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9980f1319b4256945a2d7fa326c8af'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:35.188304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9980f1319b4256945a2d7fa326c8af'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:35.209834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 938/1886] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:34 2022] DELETE /identity/v3/users/9e9980f1319b4256945a2d7fa326c8af => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:35.210655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:35.212824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3fba6-0e31-4741-9f29-ed28e500f1b1 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:35.215100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:35.245830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:35.273238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb536b33-85a1-45d4-9bc7-d436f5e41b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:35.273915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb536b33-85a1-45d4-9bc7-d436f5e41b1c service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:35.274208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb536b33-85a1-45d4-9bc7-d436f5e41b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:35.275121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb536b33-85a1-45d4-9bc7-d436f5e41b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:35.277181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-cb536b33-85a1-45d4-9bc7-d436f5e41b1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:35.288361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0a0c1-42c6-4785-87b8-b538feabe111 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:35.293617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bef17c-ce89-44de-ae06-8c4abbc80967 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47310027f0794a0c89ea0a2b08d3153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2a7af6e525e4626959b7512e792441d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:35.294493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bef17c-ce89-44de-ae06-8c4abbc80967 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:35.294933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bef17c-ce89-44de-ae06-8c4abbc80967 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:35.295215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bef17c-ce89-44de-ae06-8c4abbc80967 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:35.296112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bef17c-ce89-44de-ae06-8c4abbc80967 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:35.298023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bef17c-ce89-44de-ae06-8c4abbc80967 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:35.345071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb536b33-85a1-45d4-9bc7-d436f5e41b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:35.346519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb536b33-85a1-45d4-9bc7-d436f5e41b1c service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:35.357202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 949/1887] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:35.358538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7618c96-8978-484b-9497-f2c1184dd130 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:35.358832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7618c96-8978-484b-9497-f2c1184dd130 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:35.359121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7618c96-8978-484b-9497-f2c1184dd130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:35.379458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b7618c96-8978-484b-9497-f2c1184dd130 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:35.380624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b7618c96-8978-484b-9497-f2c1184dd130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:35.412232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 939/1888] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:35 2022] POST /identity/v3/projects => generated 354 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:35.413310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bef17c-ce89-44de-ae06-8c4abbc80967 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:35.415113 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-55bef17c-ce89-44de-ae06-8c4abbc80967 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:35.433870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:35.448297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 950/1889] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:35.452081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7618c96-8978-484b-9497-f2c1184dd130 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:35.462808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7618c96-8978-484b-9497-f2c1184dd130 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:35.500188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bef17c-ce89-44de-ae06-8c4abbc80967 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:35.505917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:35.506813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:35.507171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:35.507490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] PATH_INFO: `/v3/users/cfd7da3fffea46fa81608ca3fdfc8d39` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:35.509357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd7da3fffea46fa81608ca3fdfc8d39)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:35.511959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:35.529745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93025f-8fdc-459e-8fe5-eacc096d89dc tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47310027f0794a0c89ea0a2b08d3153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2a7af6e525e4626959b7512e792441d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:35.530531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93025f-8fdc-459e-8fe5-eacc096d89dc tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:35.530829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93025f-8fdc-459e-8fe5-eacc096d89dc tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:35.531105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93025f-8fdc-459e-8fe5-eacc096d89dc tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:35.531877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93025f-8fdc-459e-8fe5-eacc096d89dc tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:35.532191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93025f-8fdc-459e-8fe5-eacc096d89dc tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:35.534002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93025f-8fdc-459e-8fe5-eacc096d89dc tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:35.547386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 951/1890] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:35.548221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93025f-8fdc-459e-8fe5-eacc096d89dc tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:35.549931 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3f93025f-8fdc-459e-8fe5-eacc096d89dc tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:35.610635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93025f-8fdc-459e-8fe5-eacc096d89dc tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:35.615157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54649d0-6af2-4dfa-8c7c-4ed605c64297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:35.622819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54649d0-6af2-4dfa-8c7c-4ed605c64297 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:35.622819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54649d0-6af2-4dfa-8c7c-4ed605c64297 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:35.622819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54649d0-6af2-4dfa-8c7c-4ed605c64297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:35.626168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54649d0-6af2-4dfa-8c7c-4ed605c64297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:35.627625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54649d0-6af2-4dfa-8c7c-4ed605c64297 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:35.637138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 952/1891] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:35.637927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54649d0-6af2-4dfa-8c7c-4ed605c64297 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:35.639185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c54649d0-6af2-4dfa-8c7c-4ed605c64297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:35.703013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54649d0-6af2-4dfa-8c7c-4ed605c64297 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:35.707399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bd56d-b7e8-4a6b-9c74-e795a9542c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:35.708069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bd56d-b7e8-4a6b-9c74-e795a9542c35 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:35.708353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bd56d-b7e8-4a6b-9c74-e795a9542c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:35.708631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bd56d-b7e8-4a6b-9c74-e795a9542c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:35.711015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e21bd56d-b7e8-4a6b-9c74-e795a9542c35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:35.783762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bd56d-b7e8-4a6b-9c74-e795a9542c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:35.785690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bd56d-b7e8-4a6b-9c74-e795a9542c35 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:35.794728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd7da3fffea46fa81608ca3fdfc8d39'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:35.799060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 953/1892] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:35.800163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bd56d-b7e8-4a6b-9c74-e795a9542c35 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:35.804720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd7da3fffea46fa81608ca3fdfc8d39'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:35.813818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bd56d-b7e8-4a6b-9c74-e795a9542c35 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:35.819518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47310027f0794a0c89ea0a2b08d3153c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2a7af6e525e4626959b7512e792441d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:35.820540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:35.820831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:35.821916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] PATH_INFO: `/v3/projects/0404d114b30a4826a99930509ad5c37f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:35.823276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0404d114b30a4826a99930509ad5c37f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:35.825451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:35.981692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd7da3fffea46fa81608ca3fdfc8d39'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:35.982336 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd7da3fffea46fa81608ca3fdfc8d39'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:35.983079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-23b68c80-065c-4046-ba6b-3c351bd277d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd7da3fffea46fa81608ca3fdfc8d39'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.002443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0404d114b30a4826a99930509ad5c37f', 'request_id': 'req-3775a1f8-4cb8-483d-a036-f4a7fc80be66'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.006241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 940/1893] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:35 2022] DELETE /identity/v3/users/cfd7da3fffea46fa81608ca3fdfc8d39 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:36.010119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0404d114b30a4826a99930509ad5c37f', 'request_id': 'req-3775a1f8-4cb8-483d-a036-f4a7fc80be66'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.018972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0404d114b30a4826a99930509ad5c37f', 'request_id': 'req-3775a1f8-4cb8-483d-a036-f4a7fc80be66'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.029745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e55ad-8ef8-49ac-a0f4-a09554e6f6fe None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:36.030035 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e55ad-8ef8-49ac-a0f4-a09554e6f6fe None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:36.030317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e55ad-8ef8-49ac-a0f4-a09554e6f6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:36.071955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ac1e55ad-8ef8-49ac-a0f4-a09554e6f6fe None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:36.073718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ac1e55ad-8ef8-49ac-a0f4-a09554e6f6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:36.116037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] The token cache is being invalidate because project 0404d114b30a4826a99930509ad5c37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:36.116184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.119336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.123476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 954/1894] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:35 2022] DELETE /identity/v3/projects/0404d114b30a4826a99930509ad5c37f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:36.158144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 941/1895] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:36.172545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:36.174882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:36.252021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775a1f8-4cb8-483d-a036-f4a7fc80be66 tempest-VolumeQuotaClassesTest-1527804775 tempest-VolumeQuotaClassesTest-1527804775-project-admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:36.308025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a726c71-4e1b-423b-bc93-08b40e5338c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:36.309115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726c71-4e1b-423b-bc93-08b40e5338c4 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:36.309324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726c71-4e1b-423b-bc93-08b40e5338c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:36.309467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a726c71-4e1b-423b-bc93-08b40e5338c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:36.323434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a726c71-4e1b-423b-bc93-08b40e5338c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:36.325234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a726c71-4e1b-423b-bc93-08b40e5338c4 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:36.341558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 955/1896] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:36.494371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e55ad-8ef8-49ac-a0f4-a09554e6f6fe None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:36.497073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ac1e55ad-8ef8-49ac-a0f4-a09554e6f6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:36.510209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e55ad-8ef8-49ac-a0f4-a09554e6f6fe None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:36.512801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:36.543086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:36.544499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:36.544915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:36.545302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] PATH_INFO: `/v3/projects/8d29b75a5b644f23bf50726273034a68` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:36.546902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d29b75a5b644f23bf50726273034a68)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:36.549027 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:36.675445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:36.695607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d29b75a5b644f23bf50726273034a68', 'request_id': 'req-b446714b-aed6-405c-ada5-f528e1215e58'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.704085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d29b75a5b644f23bf50726273034a68', 'request_id': 'req-b446714b-aed6-405c-ada5-f528e1215e58'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.710809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d29b75a5b644f23bf50726273034a68', 'request_id': 'req-b446714b-aed6-405c-ada5-f528e1215e58'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.784021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] The token cache is being invalidate because project 8d29b75a5b644f23bf50726273034a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:36.784021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.784491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:36.792265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a726c71-4e1b-423b-bc93-08b40e5338c4 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:36.795434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 942/1897] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:36 2022] DELETE /identity/v3/projects/8d29b75a5b644f23bf50726273034a68 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:36.802941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a726c71-4e1b-423b-bc93-08b40e5338c4 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:36.904717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:36.905850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:36.906148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:36.906592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] PATH_INFO: `/v3/users/5eac2aef23a047009e388285fa636a63` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:36.908558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eac2aef23a047009e388285fa636a63)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:36.911502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:36.946486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:36.949250 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:36.973789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446714b-aed6-405c-ada5-f528e1215e58 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:36.985882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:36.986938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:36.987285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:36.987658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] PATH_INFO: `/v3/users/1d3d31e6933944dcbc251873d6083521` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:36.989373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3d31e6933944dcbc251873d6083521)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:36.991477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:37.113107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:37.236229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eac2aef23a047009e388285fa636a63'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.251200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eac2aef23a047009e388285fa636a63'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.293898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3d31e6933944dcbc251873d6083521'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.305150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3d31e6933944dcbc251873d6083521'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.370717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eac2aef23a047009e388285fa636a63'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.379041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eac2aef23a047009e388285fa636a63'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.379798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eac2aef23a047009e388285fa636a63'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.393520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 956/1898] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:36 2022] DELETE /identity/v3/users/5eac2aef23a047009e388285fa636a63 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:37.393520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:37.399746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:37.462935 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3d31e6933944dcbc251873d6083521'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.464309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3d31e6933944dcbc251873d6083521'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.469579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3d31e6933944dcbc251873d6083521'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.510280 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df03df-6007-4599-9889-5ff6616abfa9 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:37.514787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:37.515806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:37.516145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:37.516636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] PATH_INFO: `/v3/users/a517c803ec9a4442b229a90bdb40bbfc` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:37.517963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a517c803ec9a4442b229a90bdb40bbfc)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:37.521326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:37.534673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 943/1899] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:36 2022] DELETE /identity/v3/users/1d3d31e6933944dcbc251873d6083521 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:37.534673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:37.536033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:37.615318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8dd91-87c1-40b9-bde8-04131bd8c5b7 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:37.625474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:37.627873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:37.628490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:37.629356 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] PATH_INFO: `/v3/projects/624bcb48062e4a319b34d66739a0e4ca` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:37.631525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624bcb48062e4a319b34d66739a0e4ca)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:37.633687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:37.839384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a517c803ec9a4442b229a90bdb40bbfc'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.850999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624bcb48062e4a319b34d66739a0e4ca', 'request_id': 'req-d2fc6b8f-b608-43b8-8860-431356b92198'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.858409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624bcb48062e4a319b34d66739a0e4ca', 'request_id': 'req-d2fc6b8f-b608-43b8-8860-431356b92198'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.864227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a517c803ec9a4442b229a90bdb40bbfc'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.866730 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624bcb48062e4a319b34d66739a0e4ca', 'request_id': 'req-d2fc6b8f-b608-43b8-8860-431356b92198'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:37.997265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a517c803ec9a4442b229a90bdb40bbfc'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.001641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:38.010147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a517c803ec9a4442b229a90bdb40bbfc'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.011319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-571d417d-0ccd-4301-8660-c4460d45df47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a517c803ec9a4442b229a90bdb40bbfc'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.018719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 957/1900] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:37 2022] DELETE /identity/v3/users/a517c803ec9a4442b229a90bdb40bbfc => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:38.020103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dafdf7-81f1-47dd-b168-f7cfc7db64e0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:38.020478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dafdf7-81f1-47dd-b168-f7cfc7db64e0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:38.020902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dafdf7-81f1-47dd-b168-f7cfc7db64e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:38.041454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-62dafdf7-81f1-47dd-b168-f7cfc7db64e0 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:38.042782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-62dafdf7-81f1-47dd-b168-f7cfc7db64e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:38.095100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] The token cache is being invalidate because project 624bcb48062e4a319b34d66739a0e4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:38.095446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.097790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d2fc6b8f-b608-43b8-8860-431356b92198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.100215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 944/1901] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:37 2022] DELETE /identity/v3/projects/624bcb48062e4a319b34d66739a0e4ca => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:38.101792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53258e3-f6c3-4241-a7f1-1f5267eb2979 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:38.103123 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53258e3-f6c3-4241-a7f1-1f5267eb2979 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:38.103686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53258e3-f6c3-4241-a7f1-1f5267eb2979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:38.126081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f53258e3-f6c3-4241-a7f1-1f5267eb2979 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:38.133759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 958/1902] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:38.134754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dafdf7-81f1-47dd-b168-f7cfc7db64e0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:38.136948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-62dafdf7-81f1-47dd-b168-f7cfc7db64e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:38.148135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f53258e3-f6c3-4241-a7f1-1f5267eb2979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:38.159953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dafdf7-81f1-47dd-b168-f7cfc7db64e0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:38.166224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:38.167138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:38.167466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:38.167745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] PATH_INFO: `/v3/users/01659ea9fe4246429996dc320d9481b8` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:38.170581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01659ea9fe4246429996dc320d9481b8)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:38.173392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:38.173828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 945/1903] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:38.176646 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53258e3-f6c3-4241-a7f1-1f5267eb2979 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:38.184577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f53258e3-f6c3-4241-a7f1-1f5267eb2979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:38.206750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53258e3-f6c3-4241-a7f1-1f5267eb2979 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:38.213272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:38.214406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:38.214988 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:38.216195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] PATH_INFO: `/v3/projects/0454e7ce92224614aebe8bf6670915e7` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:38.218353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0454e7ce92224614aebe8bf6670915e7)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:38.222827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:38.466167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0454e7ce92224614aebe8bf6670915e7', 'request_id': 'req-4d35e23e-427d-406f-bd60-1a2dc816cad3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.469958 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01659ea9fe4246429996dc320d9481b8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.474508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0454e7ce92224614aebe8bf6670915e7', 'request_id': 'req-4d35e23e-427d-406f-bd60-1a2dc816cad3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.488604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0454e7ce92224614aebe8bf6670915e7', 'request_id': 'req-4d35e23e-427d-406f-bd60-1a2dc816cad3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.489529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01659ea9fe4246429996dc320d9481b8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.558929 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] The token cache is being invalidate because project 0454e7ce92224614aebe8bf6670915e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:38.559309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.560260 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.562109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 946/1904] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:38 2022] DELETE /identity/v3/projects/0454e7ce92224614aebe8bf6670915e7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:38.562877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:38.564231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:38.609686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01659ea9fe4246429996dc320d9481b8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.618369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01659ea9fe4246429996dc320d9481b8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.619733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01659ea9fe4246429996dc320d9481b8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:38.627585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 959/1905] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:38 2022] DELETE /identity/v3/users/01659ea9fe4246429996dc320d9481b8 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:38.628866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:38.630558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:38.653683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e23e-427d-406f-bd60-1a2dc816cad3 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:38.729978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265c7b4-8766-4141-91c6-1d58be5454d3 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:38.740132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb47a8-6e60-40f8-b466-3c64643f9e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:38.740920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb47a8-6e60-40f8-b466-3c64643f9e94 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:38.741215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb47a8-6e60-40f8-b466-3c64643f9e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:38.741501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb47a8-6e60-40f8-b466-3c64643f9e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:38.742498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50a7d6-2ce4-440e-882e-63f5eaa37bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:38.743904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a7d6-2ce4-440e-882e-63f5eaa37bad service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:38.744354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a7d6-2ce4-440e-882e-63f5eaa37bad service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:38.744634 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50a7d6-2ce4-440e-882e-63f5eaa37bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:38.746586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-be50a7d6-2ce4-440e-882e-63f5eaa37bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:38.746853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e1cb47a8-6e60-40f8-b466-3c64643f9e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:38.758949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:38.841061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb47a8-6e60-40f8-b466-3c64643f9e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:38.842522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb47a8-6e60-40f8-b466-3c64643f9e94 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:38.848104 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50a7d6-2ce4-440e-882e-63f5eaa37bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:38.850171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50a7d6-2ce4-440e-882e-63f5eaa37bad service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:38.857207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 960/1906] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:38.858922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb47a8-6e60-40f8-b466-3c64643f9e94 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:38.861950 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 947/1907] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:38.862613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e1cb47a8-6e60-40f8-b466-3c64643f9e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:38.876056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb47a8-6e60-40f8-b466-3c64643f9e94 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:38.880961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:38.881960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:38.882243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:38.882518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] PATH_INFO: `/v3/users/5c4c78e0e47447a986166b25da0903e2` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:38.884572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4c78e0e47447a986166b25da0903e2)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:38.886579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:39.090187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4c78e0e47447a986166b25da0903e2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:39.108194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4c78e0e47447a986166b25da0903e2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:39.232534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4c78e0e47447a986166b25da0903e2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:39.245660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4c78e0e47447a986166b25da0903e2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:39.247064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4c78e0e47447a986166b25da0903e2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:39.269902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 961/1908] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:38 2022] DELETE /identity/v3/users/5c4c78e0e47447a986166b25da0903e2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:39.525232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50a7d6-2ce4-440e-882e-63f5eaa37bad service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:39.527010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-be50a7d6-2ce4-440e-882e-63f5eaa37bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:39.542828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50a7d6-2ce4-440e-882e-63f5eaa37bad service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:39.631395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:39.632290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:39.632571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:39.632855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] PATH_INFO: `/v3/projects/6ba06abf899b4cabab7709d7414ee835` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:39.634733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba06abf899b4cabab7709d7414ee835)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:39.636796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:39.770013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:39.833016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:39.834948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:39.858609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27d252-32a4-45e6-bb31-0bc478179744 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:39.867288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba06abf899b4cabab7709d7414ee835', 'request_id': 'req-f5425695-63de-4c57-b966-90a4bc94c281'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:39.880494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba06abf899b4cabab7709d7414ee835', 'request_id': 'req-f5425695-63de-4c57-b966-90a4bc94c281'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:39.889429 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba06abf899b4cabab7709d7414ee835', 'request_id': 'req-f5425695-63de-4c57-b966-90a4bc94c281'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:39.933913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:39.934809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:39.935357 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:39.935778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] PATH_INFO: `/v3/projects/a41f95c64ef0420da87d3f14c7758aa8` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:39.936901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41f95c64ef0420da87d3f14c7758aa8)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:39.938787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:39.967548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] The token cache is being invalidate because project 6ba06abf899b4cabab7709d7414ee835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:39.967931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:39.968858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:39.975480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 948/1909] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:39 2022] DELETE /identity/v3/projects/6ba06abf899b4cabab7709d7414ee835 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:39.976525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:39.978019 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:39.991212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5425695-63de-4c57-b966-90a4bc94c281 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:39.996529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:39.997587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:39.997936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:39.998276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] PATH_INFO: `/v3/projects/afdeaa51d95f42a787370da4514d26c7` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:40.000095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afdeaa51d95f42a787370da4514d26c7)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:40.002048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:40.090916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41f95c64ef0420da87d3f14c7758aa8', 'request_id': 'req-b5133add-d305-45e5-8acc-722b7fe4ac2b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.097187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41f95c64ef0420da87d3f14c7758aa8', 'request_id': 'req-b5133add-d305-45e5-8acc-722b7fe4ac2b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.103152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41f95c64ef0420da87d3f14c7758aa8', 'request_id': 'req-b5133add-d305-45e5-8acc-722b7fe4ac2b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.128532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afdeaa51d95f42a787370da4514d26c7', 'request_id': 'req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.135673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afdeaa51d95f42a787370da4514d26c7', 'request_id': 'req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.141213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afdeaa51d95f42a787370da4514d26c7', 'request_id': 'req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.250132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] The token cache is being invalidate because project a41f95c64ef0420da87d3f14c7758aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:40.250470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.251088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.252684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 962/1910] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:39 2022] DELETE /identity/v3/projects/a41f95c64ef0420da87d3f14c7758aa8 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:40.253460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:40.254806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:40.317360 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5133add-d305-45e5-8acc-722b7fe4ac2b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:40.373041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:40.373925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:40.374204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:40.374479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] PATH_INFO: `/v3/projects/0f31e839793d40bb8d87f115cad7316b` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:40.375286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] The token cache is being invalidate because project afdeaa51d95f42a787370da4514d26c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:40.375665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.375758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f31e839793d40bb8d87f115cad7316b)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:40.376385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d7531fb8-bd42-4cc2-9bf8-e2cf6c447979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.377612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:40.378069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 949/1911] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:39 2022] DELETE /identity/v3/projects/afdeaa51d95f42a787370da4514d26c7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:40.379288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47a307-1c72-4dbd-a220-c736f6518aa7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:40.379597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47a307-1c72-4dbd-a220-c736f6518aa7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:40.379873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47a307-1c72-4dbd-a220-c736f6518aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:40.392684 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:40.404853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5a47a307-1c72-4dbd-a220-c736f6518aa7 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:40.406086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5a47a307-1c72-4dbd-a220-c736f6518aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:40.414626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 950/1912] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:40.415546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47a307-1c72-4dbd-a220-c736f6518aa7 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:40.416898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5a47a307-1c72-4dbd-a220-c736f6518aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:40.428622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47a307-1c72-4dbd-a220-c736f6518aa7 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:40.433897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:40.434749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:40.435384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:40.435674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] PATH_INFO: `/v3/users/ef17ef23b5bf426d86fd09d8d9991d50` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:40.436996 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef17ef23b5bf426d86fd09d8d9991d50)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:40.438870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:40.503176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f31e839793d40bb8d87f115cad7316b', 'request_id': 'req-23b99858-5cda-40e2-b06e-c3374ded1c90'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.509753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f31e839793d40bb8d87f115cad7316b', 'request_id': 'req-23b99858-5cda-40e2-b06e-c3374ded1c90'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.518003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f31e839793d40bb8d87f115cad7316b', 'request_id': 'req-23b99858-5cda-40e2-b06e-c3374ded1c90'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.634547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] The token cache is being invalidate because project 0f31e839793d40bb8d87f115cad7316b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:40.634883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.635565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.637766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 963/1913] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:40 2022] DELETE /identity/v3/projects/0f31e839793d40bb8d87f115cad7316b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:40.639157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:40.640553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:40.672696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef17ef23b5bf426d86fd09d8d9991d50'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.691932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef17ef23b5bf426d86fd09d8d9991d50'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.733213 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99858-5cda-40e2-b06e-c3374ded1c90 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:40.739461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:40.740604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:40.740990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:40.741390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] PATH_INFO: `/v3/users/47310027f0794a0c89ea0a2b08d3153c` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:40.742760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] RBAC: Authorizing `identity:delete_user(user_id=47310027f0794a0c89ea0a2b08d3153c)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:40.745904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:40.784135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef17ef23b5bf426d86fd09d8d9991d50'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.785410 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef17ef23b5bf426d86fd09d8d9991d50'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.789509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0b1eeed6-bbf5-48c4-a0de-b76d0ddaafd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef17ef23b5bf426d86fd09d8d9991d50'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:40.807003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 951/1914] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:40 2022] DELETE /identity/v3/users/ef17ef23b5bf426d86fd09d8d9991d50 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:40.808342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220d2f7-5757-4897-9c80-3bbc8091b66a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:40.808677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220d2f7-5757-4897-9c80-3bbc8091b66a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:40.809077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220d2f7-5757-4897-9c80-3bbc8091b66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:40.830119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-7220d2f7-5757-4897-9c80-3bbc8091b66a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:40.831438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-7220d2f7-5757-4897-9c80-3bbc8091b66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:40.908270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 952/1915] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:40.908270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8438759-0a02-4ff3-84d7-efb95c6238db None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:40.908270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8438759-0a02-4ff3-84d7-efb95c6238db None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:40.908270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8438759-0a02-4ff3-84d7-efb95c6238db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:40.928017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-e8438759-0a02-4ff3-84d7-efb95c6238db None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:40.929230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e8438759-0a02-4ff3-84d7-efb95c6238db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:40.939464 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 953/1916] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:40.940314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8438759-0a02-4ff3-84d7-efb95c6238db None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:40.951271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8438759-0a02-4ff3-84d7-efb95c6238db None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:40.956438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a086a5-797b-4837-813a-813e401c8cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:40.957109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a086a5-797b-4837-813a-813e401c8cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:40.957475 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a086a5-797b-4837-813a-813e401c8cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:40.957686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a086a5-797b-4837-813a-813e401c8cd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:40.958405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a086a5-797b-4837-813a-813e401c8cd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:40.958707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a086a5-797b-4837-813a-813e401c8cd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:40.960861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a086a5-797b-4837-813a-813e401c8cd3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:40.974400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 954/1917] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:40.974765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44971b6-0f90-4841-b808-bc9870a4a7fb None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:40.974985 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44971b6-0f90-4841-b808-bc9870a4a7fb None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:40.975273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44971b6-0f90-4841-b808-bc9870a4a7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.005281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47310027f0794a0c89ea0a2b08d3153c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:41.013000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d44971b6-0f90-4841-b808-bc9870a4a7fb None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:41.014579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d44971b6-0f90-4841-b808-bc9870a4a7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:41.020096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:41.026696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 955/1918] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:41.027084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47310027f0794a0c89ea0a2b08d3153c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:41.027774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44971b6-0f90-4841-b808-bc9870a4a7fb None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:41.039036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44971b6-0f90-4841-b808-bc9870a4a7fb None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:41.044012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a7b29-b16c-4efb-975a-49539899db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:41.045506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a7b29-b16c-4efb-975a-49539899db33 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.045807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a7b29-b16c-4efb-975a-49539899db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.046091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a7b29-b16c-4efb-975a-49539899db33 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.046880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a7b29-b16c-4efb-975a-49539899db33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:41.049483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a7b29-b16c-4efb-975a-49539899db33 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:41.113638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47310027f0794a0c89ea0a2b08d3153c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:41.123305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47310027f0794a0c89ea0a2b08d3153c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:41.124106 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47310027f0794a0c89ea0a2b08d3153c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:41.131302 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 964/1919] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:40 2022] DELETE /identity/v3/users/47310027f0794a0c89ea0a2b08d3153c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:41.132432 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:41.134573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:41.163416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 956/1920] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:41 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:41.168171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a7b29-b16c-4efb-975a-49539899db33 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:41.170909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-287a7b29-b16c-4efb-975a-49539899db33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:41.244553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece873c7-48b1-4ac6-8c30-305384b214db admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:41.257783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a7b29-b16c-4efb-975a-49539899db33 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:41.264823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f932ef-ad91-43df-924a-ff2339cd858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:41.265662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f932ef-ad91-43df-924a-ff2339cd858c admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.266004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f932ef-ad91-43df-924a-ff2339cd858c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.266286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f932ef-ad91-43df-924a-ff2339cd858c admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.266993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f932ef-ad91-43df-924a-ff2339cd858c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:41.269165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f932ef-ad91-43df-924a-ff2339cd858c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:41.314747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fa28c-8b49-45f0-87c3-d0b3e6c0b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:41.315587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fa28c-8b49-45f0-87c3-d0b3e6c0b7af admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.315934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fa28c-8b49-45f0-87c3-d0b3e6c0b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.316378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fa28c-8b49-45f0-87c3-d0b3e6c0b7af admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.317230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fa28c-8b49-45f0-87c3-d0b3e6c0b7af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:41.317604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fa28c-8b49-45f0-87c3-d0b3e6c0b7af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:41.319290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fa28c-8b49-45f0-87c3-d0b3e6c0b7af admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:41.332555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 965/1921] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:41.337364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fa28c-8b49-45f0-87c3-d0b3e6c0b7af admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:41.348479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fa28c-8b49-45f0-87c3-d0b3e6c0b7af admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:41.355616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59061c21-3e47-4d89-af78-47278953e74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:41.365541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 957/1922] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:41 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:41.365668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59061c21-3e47-4d89-af78-47278953e74f admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.365668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59061c21-3e47-4d89-af78-47278953e74f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.365668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59061c21-3e47-4d89-af78-47278953e74f admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.365668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59061c21-3e47-4d89-af78-47278953e74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:41.365668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59061c21-3e47-4d89-af78-47278953e74f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:41.366819 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f932ef-ad91-43df-924a-ff2339cd858c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:41.395240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f932ef-ad91-43df-924a-ff2339cd858c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:41.401730 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07007fc3-6993-4d8c-b1f2-3f5901685f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:41.402415 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07007fc3-6993-4d8c-b1f2-3f5901685f5a admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.402741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07007fc3-6993-4d8c-b1f2-3f5901685f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.403039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07007fc3-6993-4d8c-b1f2-3f5901685f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.403804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07007fc3-6993-4d8c-b1f2-3f5901685f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:41.405558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07007fc3-6993-4d8c-b1f2-3f5901685f5a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:41.416897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 958/1923] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:41.420665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07007fc3-6993-4d8c-b1f2-3f5901685f5a admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:41.431911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07007fc3-6993-4d8c-b1f2-3f5901685f5a admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:41.437130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7b957-0775-4436-ab70-7048411f23c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:41.437806 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7b957-0775-4436-ab70-7048411f23c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.438091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7b957-0775-4436-ab70-7048411f23c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.438371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7b957-0775-4436-ab70-7048411f23c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.439097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7b957-0775-4436-ab70-7048411f23c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:41.440813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7b957-0775-4436-ab70-7048411f23c6 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:41.452629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 959/1924] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:41.456763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7b957-0775-4436-ab70-7048411f23c6 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:41.470323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 966/1925] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:41 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:41.478245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59061c21-3e47-4d89-af78-47278953e74f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:41.482874 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7b957-0775-4436-ab70-7048411f23c6 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:41.577288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930057d-3b91-43c9-926e-68d21edba19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:41.578417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930057d-3b91-43c9-926e-68d21edba19d admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.578792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930057d-3b91-43c9-926e-68d21edba19d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.579479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930057d-3b91-43c9-926e-68d21edba19d admin admin] PATH_INFO: `/v3/projects/f1a1a87735644136897f4aca66c88b58/users/aad8d31518f44be98c6e908213e30d7c/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.598330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930057d-3b91-43c9-926e-68d21edba19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a1a87735644136897f4aca66c88b58, user_id=aad8d31518f44be98c6e908213e30d7c, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:41.600568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59061c21-3e47-4d89-af78-47278953e74f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:41.601273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930057d-3b91-43c9-926e-68d21edba19d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:41.606709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3798a9-da44-4893-9400-34c7293efc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:41.607444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3798a9-da44-4893-9400-34c7293efc70 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.607732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3798a9-da44-4893-9400-34c7293efc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.608080 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3798a9-da44-4893-9400-34c7293efc70 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.608791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3798a9-da44-4893-9400-34c7293efc70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:41.610707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3798a9-da44-4893-9400-34c7293efc70 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:41.717786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 960/1926] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:41 2022] PUT /identity/v3/projects/f1a1a87735644136897f4aca66c88b58/users/aad8d31518f44be98c6e908213e30d7c/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:41.718914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930057d-3b91-43c9-926e-68d21edba19d admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:41.720742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f930057d-3b91-43c9-926e-68d21edba19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:41.751145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 967/1927] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:41 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:41.760487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5816d8a-74c4-43ae-ace4-011229b9a023 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.760487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5816d8a-74c4-43ae-ace4-011229b9a023 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.760487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5816d8a-74c4-43ae-ace4-011229b9a023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.795306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a5816d8a-74c4-43ae-ace4-011229b9a023 None None] MFA Rules not processed for user `aad8d31518f44be98c6e908213e30d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:41.796814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a5816d8a-74c4-43ae-ace4-011229b9a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:41.810592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930057d-3b91-43c9-926e-68d21edba19d admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:41.818668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:41.820168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.820657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.820970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] PATH_INFO: `/v3/projects/9fbaff083f314c508027a83d778dd125` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.824267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fbaff083f314c508027a83d778dd125)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:41.826202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:41.842512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:41.873355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 968/1928] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:41.874248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5816d8a-74c4-43ae-ace4-011229b9a023 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:41.878403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a5816d8a-74c4-43ae-ace4-011229b9a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:41.893370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5816d8a-74c4-43ae-ace4-011229b9a023 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:41.898082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:41.898966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:41.899274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:41.899591 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] PATH_INFO: `/v3/projects/f2a7af6e525e4626959b7512e792441d` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:41.900773 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a7af6e525e4626959b7512e792441d)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:41.902717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:41.935402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fbaff083f314c508027a83d778dd125', 'request_id': 'req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:41.941819 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fbaff083f314c508027a83d778dd125', 'request_id': 'req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:41.948075 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fbaff083f314c508027a83d778dd125', 'request_id': 'req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.021060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a7af6e525e4626959b7512e792441d', 'request_id': 'req-38780a43-9d9d-4ad3-8d67-c8191caebe7b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.027681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a7af6e525e4626959b7512e792441d', 'request_id': 'req-38780a43-9d9d-4ad3-8d67-c8191caebe7b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.031979 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] The token cache is being invalidate because project 9fbaff083f314c508027a83d778dd125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:42.032271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.034101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.034210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a7af6e525e4626959b7512e792441d', 'request_id': 'req-38780a43-9d9d-4ad3-8d67-c8191caebe7b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.038719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 961/1929] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:41 2022] DELETE /identity/v3/projects/9fbaff083f314c508027a83d778dd125 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:42.039625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.041609 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.108809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849f8c0-47f2-45c1-bd19-5500f9bbf89c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.116364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] The token cache is being invalidate because project f2a7af6e525e4626959b7512e792441d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:42.116761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.117455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.119906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 969/1930] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:41 2022] DELETE /identity/v3/projects/f2a7af6e525e4626959b7512e792441d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:42.120941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.122529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.168056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fdbaa-fab4-49ec-b2b4-bfd90fbd1609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.168763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fdbaa-fab4-49ec-b2b4-bfd90fbd1609 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.169058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fdbaa-fab4-49ec-b2b4-bfd90fbd1609 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.169483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fdbaa-fab4-49ec-b2b4-bfd90fbd1609 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.170280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fdbaa-fab4-49ec-b2b4-bfd90fbd1609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.171906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fdbaa-fab4-49ec-b2b4-bfd90fbd1609 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:42.181608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38780a43-9d9d-4ad3-8d67-c8191caebe7b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.182568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 962/1931] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:42.183897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9451-34b9-45f6-b32a-4bfa8f2c66e7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.184209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9451-34b9-45f6-b32a-4bfa8f2c66e7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.184485 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9451-34b9-45f6-b32a-4bfa8f2c66e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.186763 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f211a9-198d-4653-9053-d35a08d8cc11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.187443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f211a9-198d-4653-9053-d35a08d8cc11 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.187724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f211a9-198d-4653-9053-d35a08d8cc11 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.187998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f211a9-198d-4653-9053-d35a08d8cc11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.189788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f9f211a9-198d-4653-9053-d35a08d8cc11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.204899 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-337f9451-34b9-45f6-b32a-4bfa8f2c66e7 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:42.206160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-337f9451-34b9-45f6-b32a-4bfa8f2c66e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.217112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 963/1932] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:42.218295 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff701c2-f1fb-4dfc-ae24-e183ba66b933 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.218579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff701c2-f1fb-4dfc-ae24-e183ba66b933 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.218855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff701c2-f1fb-4dfc-ae24-e183ba66b933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.238050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9ff701c2-f1fb-4dfc-ae24-e183ba66b933 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:42.239258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9ff701c2-f1fb-4dfc-ae24-e183ba66b933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.248408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 964/1933] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:42.249104 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff701c2-f1fb-4dfc-ae24-e183ba66b933 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.250336 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9ff701c2-f1fb-4dfc-ae24-e183ba66b933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.256518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f211a9-198d-4653-9053-d35a08d8cc11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.258083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f211a9-198d-4653-9053-d35a08d8cc11 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:42.262506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff701c2-f1fb-4dfc-ae24-e183ba66b933 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.267509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816ddb2-63d9-4d79-89c8-4ee0be0bfbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.268120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 970/1934] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:42.269399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a65a1f-655d-40dc-9df5-28e11cc9aab9 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.269736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a65a1f-655d-40dc-9df5-28e11cc9aab9 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.269953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a65a1f-655d-40dc-9df5-28e11cc9aab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.272136 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ddb2-63d9-4d79-89c8-4ee0be0bfbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.272635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ddb2-63d9-4d79-89c8-4ee0be0bfbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.273083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ddb2-63d9-4d79-89c8-4ee0be0bfbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.274703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816ddb2-63d9-4d79-89c8-4ee0be0bfbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.277050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816ddb2-63d9-4d79-89c8-4ee0be0bfbc1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:42.289205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 965/1935] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:42.291310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd2a4-4615-4af9-a3e2-2973e34ba6fc None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.291650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd2a4-4615-4af9-a3e2-2973e34ba6fc None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.291952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efd2a4-4615-4af9-a3e2-2973e34ba6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.298294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b7a65a1f-655d-40dc-9df5-28e11cc9aab9 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:42.299964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b7a65a1f-655d-40dc-9df5-28e11cc9aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.309561 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 971/1936] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:42.310675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a65a1f-655d-40dc-9df5-28e11cc9aab9 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.312097 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b7a65a1f-655d-40dc-9df5-28e11cc9aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.314538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-15efd2a4-4615-4af9-a3e2-2973e34ba6fc None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:42.315830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-15efd2a4-4615-4af9-a3e2-2973e34ba6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.323987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a65a1f-655d-40dc-9df5-28e11cc9aab9 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.324468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 966/1937] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:42.328246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efd2a4-4615-4af9-a3e2-2973e34ba6fc None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.328759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.329622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.329929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.330188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] PATH_INFO: `/v3/users/aad8d31518f44be98c6e908213e30d7c` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.331398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad8d31518f44be98c6e908213e30d7c)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.333315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:42.338606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efd2a4-4615-4af9-a3e2-2973e34ba6fc None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.343290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1f311-35c7-4ca2-af11-f4603dbb42ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.344216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1f311-35c7-4ca2-af11-f4603dbb42ed admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.344494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1f311-35c7-4ca2-af11-f4603dbb42ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.344768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1f311-35c7-4ca2-af11-f4603dbb42ed admin admin] PATH_INFO: `/v3/projects/11d26bc5afa8454eba9ff929d5334a94/users/2930bcc7295e4569a5211e93233eb362/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.360350 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1f311-35c7-4ca2-af11-f4603dbb42ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d26bc5afa8454eba9ff929d5334a94, user_id=2930bcc7295e4569a5211e93233eb362, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.363027 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1f311-35c7-4ca2-af11-f4603dbb42ed admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:42.513691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 967/1938] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:42 2022] PUT /identity/v3/projects/11d26bc5afa8454eba9ff929d5334a94/users/2930bcc7295e4569a5211e93233eb362/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:42.514531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1f311-35c7-4ca2-af11-f4603dbb42ed admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.577157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad8d31518f44be98c6e908213e30d7c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.585403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1f311-35c7-4ca2-af11-f4603dbb42ed admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.592860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695a6e-1d8b-4969-b792-ebc6f57d8cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.593663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695a6e-1d8b-4969-b792-ebc6f57d8cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.594044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695a6e-1d8b-4969-b792-ebc6f57d8cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.594395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad8d31518f44be98c6e908213e30d7c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.594567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695a6e-1d8b-4969-b792-ebc6f57d8cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.595300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695a6e-1d8b-4969-b792-ebc6f57d8cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:42.595738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695a6e-1d8b-4969-b792-ebc6f57d8cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.597624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695a6e-1d8b-4969-b792-ebc6f57d8cc5 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:42.605893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:42.611689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 968/1939] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:42.612555 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695a6e-1d8b-4969-b792-ebc6f57d8cc5 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.622949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695a6e-1d8b-4969-b792-ebc6f57d8cc5 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.627635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc663e-d032-4ced-8ca7-1eeeda55d367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.628258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc663e-d032-4ced-8ca7-1eeeda55d367 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.628542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc663e-d032-4ced-8ca7-1eeeda55d367 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.628817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc663e-d032-4ced-8ca7-1eeeda55d367 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.629513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc663e-d032-4ced-8ca7-1eeeda55d367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:42.634197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc663e-d032-4ced-8ca7-1eeeda55d367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.634197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc663e-d032-4ced-8ca7-1eeeda55d367 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:42.644133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 969/1940] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:42.645384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea46b4-9b2b-4f4f-be8c-41ce95d60b90 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.645675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea46b4-9b2b-4f4f-be8c-41ce95d60b90 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.645954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea46b4-9b2b-4f4f-be8c-41ce95d60b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.649778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad8d31518f44be98c6e908213e30d7c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.657997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad8d31518f44be98c6e908213e30d7c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.658722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad8d31518f44be98c6e908213e30d7c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:42.664791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 972/1941] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:42 2022] DELETE /identity/v3/users/aad8d31518f44be98c6e908213e30d7c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:42.665944 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.667309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.673012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b7ea46b4-9b2b-4f4f-be8c-41ce95d60b90 None None] MFA Rules not processed for user `2930bcc7295e4569a5211e93233eb362`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:42.674445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b7ea46b4-9b2b-4f4f-be8c-41ce95d60b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.733289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae0b5b-8c6a-4c35-97a5-1549e704a193 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.737867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a41ddf-bfda-45ea-a12a-825611f027a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.738530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a41ddf-bfda-45ea-a12a-825611f027a4 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.738817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a41ddf-bfda-45ea-a12a-825611f027a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.739094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a41ddf-bfda-45ea-a12a-825611f027a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.739837 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a41ddf-bfda-45ea-a12a-825611f027a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.741739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a41ddf-bfda-45ea-a12a-825611f027a4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:42.743932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 970/1942] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:42.744826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea46b4-9b2b-4f4f-be8c-41ce95d60b90 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.746245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b7ea46b4-9b2b-4f4f-be8c-41ce95d60b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.759585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea46b4-9b2b-4f4f-be8c-41ce95d60b90 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.764214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20494-e51d-4317-88ca-4feb7065c89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.764876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20494-e51d-4317-88ca-4feb7065c89c admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.765157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20494-e51d-4317-88ca-4feb7065c89c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.765433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d20494-e51d-4317-88ca-4feb7065c89c admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.766119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d20494-e51d-4317-88ca-4feb7065c89c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.768126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d20494-e51d-4317-88ca-4feb7065c89c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:42.861218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 973/1943] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:42 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:42.861218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668897-02af-4c0b-be22-817e686abd5c None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.861218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668897-02af-4c0b-be22-817e686abd5c None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.861218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668897-02af-4c0b-be22-817e686abd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.878166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b2668897-02af-4c0b-be22-817e686abd5c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:42.879414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b2668897-02af-4c0b-be22-817e686abd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.885666 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:42.890393 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 971/1944] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:42 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:42.891182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20494-e51d-4317-88ca-4feb7065c89c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.892880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-23d20494-e51d-4317-88ca-4feb7065c89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:42.948741 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 974/1945] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:42.949649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2668897-02af-4c0b-be22-817e686abd5c None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:42.959330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2668897-02af-4c0b-be22-817e686abd5c None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.964188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95f4e0-70d6-49d9-b6b2-96a60bf29f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.964861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f4e0-70d6-49d9-b6b2-96a60bf29f99 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.965147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f4e0-70d6-49d9-b6b2-96a60bf29f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.965423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f4e0-70d6-49d9-b6b2-96a60bf29f99 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.966114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95f4e0-70d6-49d9-b6b2-96a60bf29f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.967757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d20494-e51d-4317-88ca-4feb7065c89c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:42.968311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95f4e0-70d6-49d9-b6b2-96a60bf29f99 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:42.972255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5cdc9-235e-43aa-ad10-7302af90faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:42.972927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5cdc9-235e-43aa-ad10-7302af90faf6 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:42.973303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5cdc9-235e-43aa-ad10-7302af90faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:42.973529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5cdc9-235e-43aa-ad10-7302af90faf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:42.974208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5cdc9-235e-43aa-ad10-7302af90faf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:42.976122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5cdc9-235e-43aa-ad10-7302af90faf6 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.045957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 975/1946] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:42 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:43.045957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95f4e0-70d6-49d9-b6b2-96a60bf29f99 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.057126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95f4e0-70d6-49d9-b6b2-96a60bf29f99 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.062757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea89e95-65de-464f-8ec0-c536711613e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.063540 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea89e95-65de-464f-8ec0-c536711613e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.063831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea89e95-65de-464f-8ec0-c536711613e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.064113 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea89e95-65de-464f-8ec0-c536711613e0 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.064916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea89e95-65de-464f-8ec0-c536711613e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.066868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea89e95-65de-464f-8ec0-c536711613e0 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.110071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 972/1947] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:42 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:43.111035 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5cdc9-235e-43aa-ad10-7302af90faf6 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.112793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1bc5cdc9-235e-43aa-ad10-7302af90faf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:43.169611 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5cdc9-235e-43aa-ad10-7302af90faf6 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.173369 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dd811-3eeb-4290-9f7b-9360249cf11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.174018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dd811-3eeb-4290-9f7b-9360249cf11a service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.174294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dd811-3eeb-4290-9f7b-9360249cf11a service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.174567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dd811-3eeb-4290-9f7b-9360249cf11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.190547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 976/1948] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:43 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:43.190547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea89e95-65de-464f-8ec0-c536711613e0 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.198786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea89e95-65de-464f-8ec0-c536711613e0 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.250486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dd811-3eeb-4290-9f7b-9360249cf11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.252038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dd811-3eeb-4290-9f7b-9360249cf11a service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.259796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac27bb-8170-4a1f-b051-adba539833ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.260644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac27bb-8170-4a1f-b051-adba539833ae admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.261010 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac27bb-8170-4a1f-b051-adba539833ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.261352 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac27bb-8170-4a1f-b051-adba539833ae admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.262160 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac27bb-8170-4a1f-b051-adba539833ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.263541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 973/1949] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:43.263930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac27bb-8170-4a1f-b051-adba539833ae admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.264361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dd811-3eeb-4290-9f7b-9360249cf11a service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.275137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dd811-3eeb-4290-9f7b-9360249cf11a service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.279285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 977/1950] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:43.280354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac27bb-8170-4a1f-b051-adba539833ae admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.281595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fa52c-91e4-4062-8030-71073450b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.282305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa52c-91e4-4062-8030-71073450b497 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.282660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa52c-91e4-4062-8030-71073450b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.282865 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa52c-91e4-4062-8030-71073450b497 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.283582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fa52c-91e4-4062-8030-71073450b497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.285507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fa52c-91e4-4062-8030-71073450b497 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.293871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac27bb-8170-4a1f-b051-adba539833ae admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.300104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f717d-f3cd-4952-b017-9e7f7c1132f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.301175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f717d-f3cd-4952-b017-9e7f7c1132f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.301469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f717d-f3cd-4952-b017-9e7f7c1132f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.301740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f717d-f3cd-4952-b017-9e7f7c1132f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.302749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f717d-f3cd-4952-b017-9e7f7c1132f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.304449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f717d-f3cd-4952-b017-9e7f7c1132f3 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.318723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 978/1951] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:43.323558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f717d-f3cd-4952-b017-9e7f7c1132f3 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.334408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f717d-f3cd-4952-b017-9e7f7c1132f3 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.340348 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55465bc8-ba53-4b12-afb6-a38be1e1db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.341085 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55465bc8-ba53-4b12-afb6-a38be1e1db28 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.341384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55465bc8-ba53-4b12-afb6-a38be1e1db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.341732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55465bc8-ba53-4b12-afb6-a38be1e1db28 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.342506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55465bc8-ba53-4b12-afb6-a38be1e1db28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.344572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55465bc8-ba53-4b12-afb6-a38be1e1db28 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.357835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 979/1952] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:43.358861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55465bc8-ba53-4b12-afb6-a38be1e1db28 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.378414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55465bc8-ba53-4b12-afb6-a38be1e1db28 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.383181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5daca1-d707-4fad-bb9f-fbf1eb246c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.384593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5daca1-d707-4fad-bb9f-fbf1eb246c86 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.384593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5daca1-d707-4fad-bb9f-fbf1eb246c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.384593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5daca1-d707-4fad-bb9f-fbf1eb246c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.385217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5daca1-d707-4fad-bb9f-fbf1eb246c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.386792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5daca1-d707-4fad-bb9f-fbf1eb246c86 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.396654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 980/1953] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:43.397420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5daca1-d707-4fad-bb9f-fbf1eb246c86 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.407661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5daca1-d707-4fad-bb9f-fbf1eb246c86 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.410197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 974/1954] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:43 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:43.411068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fa52c-91e4-4062-8030-71073450b497 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.413473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6150b-d621-4583-903e-c177eb4ae773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.414729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6150b-d621-4583-903e-c177eb4ae773 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.426784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6150b-d621-4583-903e-c177eb4ae773 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.426784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6150b-d621-4583-903e-c177eb4ae773 admin admin] PATH_INFO: `/v3/projects/aca4ac9e773b490dbe46f1725cb5e340/users/318b95578d7748bfa2b715bd3a4aa8e0/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.427024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fa52c-91e4-4062-8030-71073450b497 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.427024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81806c-0e3c-412e-9f24-8b431d6f40fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.427616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81806c-0e3c-412e-9f24-8b431d6f40fb admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.427900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81806c-0e3c-412e-9f24-8b431d6f40fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.428279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81806c-0e3c-412e-9f24-8b431d6f40fb admin admin] PATH_INFO: `/v3/projects/8d7d0100b4e64e9780aa128ddef097f9/users/0b09b63297314dda81fa2f19f25d6601/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.434132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6150b-d621-4583-903e-c177eb4ae773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca4ac9e773b490dbe46f1725cb5e340, user_id=318b95578d7748bfa2b715bd3a4aa8e0, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.437226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6150b-d621-4583-903e-c177eb4ae773 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.443854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81806c-0e3c-412e-9f24-8b431d6f40fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7d0100b4e64e9780aa128ddef097f9, user_id=0b09b63297314dda81fa2f19f25d6601, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.447176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81806c-0e3c-412e-9f24-8b431d6f40fb admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.559043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 981/1955] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:43 2022] PUT /identity/v3/projects/aca4ac9e773b490dbe46f1725cb5e340/users/318b95578d7748bfa2b715bd3a4aa8e0/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:43.562183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 975/1956] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:43 2022] PUT /identity/v3/projects/8d7d0100b4e64e9780aa128ddef097f9/users/0b09b63297314dda81fa2f19f25d6601/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:43.579279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6150b-d621-4583-903e-c177eb4ae773 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.580256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66289e34-867e-4e29-9d78-e72202a9f430 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.580553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66289e34-867e-4e29-9d78-e72202a9f430 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.581081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66289e34-867e-4e29-9d78-e72202a9f430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.622782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-66289e34-867e-4e29-9d78-e72202a9f430 None None] MFA Rules not processed for user `318b95578d7748bfa2b715bd3a4aa8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:43.624206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-66289e34-867e-4e29-9d78-e72202a9f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:43.660053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6150b-d621-4583-903e-c177eb4ae773 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.708028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 976/1957] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:43.709321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22ae7-e14f-46c2-8c4e-c683739e84fd None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.709612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22ae7-e14f-46c2-8c4e-c683739e84fd None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.709884 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22ae7-e14f-46c2-8c4e-c683739e84fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.734457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985a232-0436-4f49-af5f-24b29bc40132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.735146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a232-0436-4f49-af5f-24b29bc40132 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.735483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a232-0436-4f49-af5f-24b29bc40132 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.735759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a232-0436-4f49-af5f-24b29bc40132 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.736503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985a232-0436-4f49-af5f-24b29bc40132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.738188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985a232-0436-4f49-af5f-24b29bc40132 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.740556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-7dd22ae7-e14f-46c2-8c4e-c683739e84fd None None] MFA Rules not processed for user `0b09b63297314dda81fa2f19f25d6601`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:43.741799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-7dd22ae7-e14f-46c2-8c4e-c683739e84fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:43.749613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 982/1958] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:43.750762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985a232-0436-4f49-af5f-24b29bc40132 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.752888 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3985a232-0436-4f49-af5f-24b29bc40132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:43.816798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985a232-0436-4f49-af5f-24b29bc40132 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.817894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 977/1959] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:43.818943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22ae7-e14f-46c2-8c4e-c683739e84fd None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.826713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8807e0-d5ca-4c3f-821d-0bb6aa7e33d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd039be6500e74ae3a6f30821c5c19a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.828298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8807e0-d5ca-4c3f-821d-0bb6aa7e33d3 service glance] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.828590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8807e0-d5ca-4c3f-821d-0bb6aa7e33d3 service glance] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.828874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8807e0-d5ca-4c3f-821d-0bb6aa7e33d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.833013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22ae7-e14f-46c2-8c4e-c683739e84fd None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.837291 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:43.840705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c236d2b-6ebb-4199-8850-b137c0816dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.844360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c236d2b-6ebb-4199-8850-b137c0816dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.844360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c236d2b-6ebb-4199-8850-b137c0816dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.844746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8807e0-d5ca-4c3f-821d-0bb6aa7e33d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.844842 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c236d2b-6ebb-4199-8850-b137c0816dd1 admin admin] PATH_INFO: `/v3/projects/614640f3e36449fc9bbefc5458d849e0/users/70314aef896647d895fca35d15fc8b31/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.844926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8807e0-d5ca-4c3f-821d-0bb6aa7e33d3 service glance] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.854745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 983/1960] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:43.855903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8807e0-d5ca-4c3f-821d-0bb6aa7e33d3 service glance] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:43.857676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4f8807e0-d5ca-4c3f-821d-0bb6aa7e33d3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:43.859945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c236d2b-6ebb-4199-8850-b137c0816dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=614640f3e36449fc9bbefc5458d849e0, user_id=70314aef896647d895fca35d15fc8b31, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.864034 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c236d2b-6ebb-4199-8850-b137c0816dd1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.872778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8807e0-d5ca-4c3f-821d-0bb6aa7e33d3 service glance] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:43.878356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:43.878525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:43.878949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:43.879232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] PATH_INFO: `/v3/projects/f1a1a87735644136897f4aca66c88b58` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:43.880639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a1a87735644136897f4aca66c88b58)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:43.882567 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:43.980983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 978/1961] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:43 2022] PUT /identity/v3/projects/614640f3e36449fc9bbefc5458d849e0/users/70314aef896647d895fca35d15fc8b31/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:43.981791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c236d2b-6ebb-4199-8850-b137c0816dd1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.030217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a1a87735644136897f4aca66c88b58', 'request_id': 'req-91958bbe-a532-498b-af10-c63e4f8eb134'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:44.036525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a1a87735644136897f4aca66c88b58', 'request_id': 'req-91958bbe-a532-498b-af10-c63e4f8eb134'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:44.047184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a1a87735644136897f4aca66c88b58', 'request_id': 'req-91958bbe-a532-498b-af10-c63e4f8eb134'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:44.053302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c236d2b-6ebb-4199-8850-b137c0816dd1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.112583 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68bdb6-db86-48d4-999b-1825d18cb988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.113335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68bdb6-db86-48d4-999b-1825d18cb988 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.113705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68bdb6-db86-48d4-999b-1825d18cb988 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.114061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68bdb6-db86-48d4-999b-1825d18cb988 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.114762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68bdb6-db86-48d4-999b-1825d18cb988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.116836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68bdb6-db86-48d4-999b-1825d18cb988 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.174904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] The token cache is being invalidate because project f1a1a87735644136897f4aca66c88b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:44.175192 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:44.178972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:44.178972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 984/1962] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:43 2022] DELETE /identity/v3/projects/f1a1a87735644136897f4aca66c88b58 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:44.178972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.179587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:44.192737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91958bbe-a532-498b-af10-c63e4f8eb134 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.198014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7eb88-c72a-48a4-988c-e46ede44b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.198662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7eb88-c72a-48a4-988c-e46ede44b150 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.198949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7eb88-c72a-48a4-988c-e46ede44b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.199216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7eb88-c72a-48a4-988c-e46ede44b150 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.199971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7eb88-c72a-48a4-988c-e46ede44b150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.201698 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7eb88-c72a-48a4-988c-e46ede44b150 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.212976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 985/1963] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:44.214361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ddb13-57a7-4dda-b685-24bea93c3aed None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.214704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ddb13-57a7-4dda-b685-24bea93c3aed None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.214994 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ddb13-57a7-4dda-b685-24bea93c3aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.233150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-2f0ddb13-57a7-4dda-b685-24bea93c3aed None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:44.234347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2f0ddb13-57a7-4dda-b685-24bea93c3aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:44.242485 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 986/1964] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:44.243197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:44.243445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ddb13-57a7-4dda-b685-24bea93c3aed None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.253954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ddb13-57a7-4dda-b685-24bea93c3aed None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.259470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d4dfe-b4f7-4efe-a0cb-211f75709ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.260630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d4dfe-b4f7-4efe-a0cb-211f75709ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.260913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d4dfe-b4f7-4efe-a0cb-211f75709ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.261193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d4dfe-b4f7-4efe-a0cb-211f75709ef3 admin admin] PATH_INFO: `/v3/projects/614640f3e36449fc9bbefc5458d849e0/users/70314aef896647d895fca35d15fc8b31/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.263193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d4dfe-b4f7-4efe-a0cb-211f75709ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=614640f3e36449fc9bbefc5458d849e0, user_id=70314aef896647d895fca35d15fc8b31, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.265972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d4dfe-b4f7-4efe-a0cb-211f75709ef3 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.277863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 987/1965] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:44 2022] PUT /identity/v3/projects/614640f3e36449fc9bbefc5458d849e0/users/70314aef896647d895fca35d15fc8b31/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:44.279212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57660e8b-5617-4c50-8cf2-fec5481d758e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.279580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57660e8b-5617-4c50-8cf2-fec5481d758e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.285384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57660e8b-5617-4c50-8cf2-fec5481d758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.285503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 979/1966] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:43 2022] POST /identity/v3/projects => generated 383 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:44.290762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68bdb6-db86-48d4-999b-1825d18cb988 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.292421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ac68bdb6-db86-48d4-999b-1825d18cb988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:44.304196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-57660e8b-5617-4c50-8cf2-fec5481d758e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:44.305625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-57660e8b-5617-4c50-8cf2-fec5481d758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:44.358828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68bdb6-db86-48d4-999b-1825d18cb988 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.363760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9101d-5b02-4512-8ee3-1d9f2520b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.364469 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9101d-5b02-4512-8ee3-1d9f2520b1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.364758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9101d-5b02-4512-8ee3-1d9f2520b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.365040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9101d-5b02-4512-8ee3-1d9f2520b1b7 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.365885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9101d-5b02-4512-8ee3-1d9f2520b1b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.368341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9101d-5b02-4512-8ee3-1d9f2520b1b7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.370036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 988/1967] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:44.371312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420b004-cb7b-434c-b9a3-eaea837c349a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.371633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420b004-cb7b-434c-b9a3-eaea837c349a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.371913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420b004-cb7b-434c-b9a3-eaea837c349a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.401212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-0420b004-cb7b-434c-b9a3-eaea837c349a None None] MFA Rules not processed for user `70314aef896647d895fca35d15fc8b31`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:44.402408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0420b004-cb7b-434c-b9a3-eaea837c349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:44.470732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 989/1968] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:44.471710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420b004-cb7b-434c-b9a3-eaea837c349a None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.483042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420b004-cb7b-434c-b9a3-eaea837c349a None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.487901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fa535-54a3-49de-aab6-d9f05184e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.488554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fa535-54a3-49de-aab6-d9f05184e356 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.488839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fa535-54a3-49de-aab6-d9f05184e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.489125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fa535-54a3-49de-aab6-d9f05184e356 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.489848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fa535-54a3-49de-aab6-d9f05184e356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:44.490161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fa535-54a3-49de-aab6-d9f05184e356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.491826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fa535-54a3-49de-aab6-d9f05184e356 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.504427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 990/1969] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:44.505501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fa535-54a3-49de-aab6-d9f05184e356 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.507205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-685fa535-54a3-49de-aab6-d9f05184e356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:44.552633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 980/1970] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:44 2022] POST /identity/v3/users => generated 298 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:44.553774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9101d-5b02-4512-8ee3-1d9f2520b1b7 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.565050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9101d-5b02-4512-8ee3-1d9f2520b1b7 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.568955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fa535-54a3-49de-aab6-d9f05184e356 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.569917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877a1c-d940-41b1-80c5-5f5bee1d1463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.570568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877a1c-d940-41b1-80c5-5f5bee1d1463 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.571036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877a1c-d940-41b1-80c5-5f5bee1d1463 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.571323 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5877a1c-d940-41b1-80c5-5f5bee1d1463 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.572034 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5877a1c-d940-41b1-80c5-5f5bee1d1463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.572918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3171cd-a118-4f00-bbbc-0b8985ec29af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.573562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3171cd-a118-4f00-bbbc-0b8985ec29af service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.573869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3171cd-a118-4f00-bbbc-0b8985ec29af service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.579932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5877a1c-d940-41b1-80c5-5f5bee1d1463 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.580069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3171cd-a118-4f00-bbbc-0b8985ec29af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.583929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3171cd-a118-4f00-bbbc-0b8985ec29af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.585345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3171cd-a118-4f00-bbbc-0b8985ec29af service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.595555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 991/1971] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:44.596400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3171cd-a118-4f00-bbbc-0b8985ec29af service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.606946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3171cd-a118-4f00-bbbc-0b8985ec29af service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.611719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6356897-f52f-4b5e-b04f-710eb21ffa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.612444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6356897-f52f-4b5e-b04f-710eb21ffa55 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.612659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6356897-f52f-4b5e-b04f-710eb21ffa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.612945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6356897-f52f-4b5e-b04f-710eb21ffa55 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.613694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6356897-f52f-4b5e-b04f-710eb21ffa55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.615273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6356897-f52f-4b5e-b04f-710eb21ffa55 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.625202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 992/1972] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:44.629295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6356897-f52f-4b5e-b04f-710eb21ffa55 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.638770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6356897-f52f-4b5e-b04f-710eb21ffa55 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.643402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb18c-d8e3-4241-b1eb-ffbc34af6cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.644265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb18c-d8e3-4241-b1eb-ffbc34af6cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.644549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb18c-d8e3-4241-b1eb-ffbc34af6cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.644827 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb18c-d8e3-4241-b1eb-ffbc34af6cdd admin admin] PATH_INFO: `/v3/projects/ceeb7dc372384ba9b69cb4104c5693e3/users/65aa3fdc2cec40a59877f62d4dabf3a9/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.660771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb18c-d8e3-4241-b1eb-ffbc34af6cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceeb7dc372384ba9b69cb4104c5693e3, user_id=65aa3fdc2cec40a59877f62d4dabf3a9, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.663338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb18c-d8e3-4241-b1eb-ffbc34af6cdd admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.675580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 981/1973] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:44 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:44.679515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877a1c-d940-41b1-80c5-5f5bee1d1463 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.744088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 993/1974] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:44 2022] PUT /identity/v3/projects/ceeb7dc372384ba9b69cb4104c5693e3/users/65aa3fdc2cec40a59877f62d4dabf3a9/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:44.747578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5877a1c-d940-41b1-80c5-5f5bee1d1463 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.749020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb18c-d8e3-4241-b1eb-ffbc34af6cdd admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.825637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbb09b-fbd5-4b30-a859-7471a67c82d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.826639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb09b-fbd5-4b30-a859-7471a67c82d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.827063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb09b-fbd5-4b30-a859-7471a67c82d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.827524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb09b-fbd5-4b30-a859-7471a67c82d0 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.829395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbb09b-fbd5-4b30-a859-7471a67c82d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.830129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbb09b-fbd5-4b30-a859-7471a67c82d0 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.844762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb18c-d8e3-4241-b1eb-ffbc34af6cdd admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.850250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88936b04-74e3-4876-b0c5-0b95ed0b5bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.851013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88936b04-74e3-4876-b0c5-0b95ed0b5bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.851391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88936b04-74e3-4876-b0c5-0b95ed0b5bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.851683 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88936b04-74e3-4876-b0c5-0b95ed0b5bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.853255 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88936b04-74e3-4876-b0c5-0b95ed0b5bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.855146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88936b04-74e3-4876-b0c5-0b95ed0b5bd2 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.865794 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 994/1975] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:44.870918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88936b04-74e3-4876-b0c5-0b95ed0b5bd2 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.880962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88936b04-74e3-4876-b0c5-0b95ed0b5bd2 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:44.886721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67d07d-96dc-4ec7-a343-a831aee50a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:44.887633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67d07d-96dc-4ec7-a343-a831aee50a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.887926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67d07d-96dc-4ec7-a343-a831aee50a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.888210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67d07d-96dc-4ec7-a343-a831aee50a99 admin admin] PATH_INFO: `/v3/projects/ceeb7dc372384ba9b69cb4104c5693e3/users/65aa3fdc2cec40a59877f62d4dabf3a9/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.890375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67d07d-96dc-4ec7-a343-a831aee50a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceeb7dc372384ba9b69cb4104c5693e3, user_id=65aa3fdc2cec40a59877f62d4dabf3a9, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:44.893226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67d07d-96dc-4ec7-a343-a831aee50a99 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:44.903809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 995/1976] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:44 2022] PUT /identity/v3/projects/ceeb7dc372384ba9b69cb4104c5693e3/users/65aa3fdc2cec40a59877f62d4dabf3a9/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:44.915886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52340b9-da8c-40cc-8c0b-4c61bb8d3bd6 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:44.915886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52340b9-da8c-40cc-8c0b-4c61bb8d3bd6 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:44.915886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52340b9-da8c-40cc-8c0b-4c61bb8d3bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:44.944282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f52340b9-da8c-40cc-8c0b-4c61bb8d3bd6 None None] MFA Rules not processed for user `65aa3fdc2cec40a59877f62d4dabf3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:44.948685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 982/1977] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:44 2022] POST /identity/v3/users => generated 286 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:44.948831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f52340b9-da8c-40cc-8c0b-4c61bb8d3bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:44.949531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbb09b-fbd5-4b30-a859-7471a67c82d0 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:44.960901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbb09b-fbd5-4b30-a859-7471a67c82d0 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:45.023733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 996/1978] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:45.024720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352efe69-5217-479e-849d-ed2962174123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:45.025995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352efe69-5217-479e-849d-ed2962174123 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:45.026257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352efe69-5217-479e-849d-ed2962174123 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:45.026540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352efe69-5217-479e-849d-ed2962174123 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:45.027446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352efe69-5217-479e-849d-ed2962174123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:45.029165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352efe69-5217-479e-849d-ed2962174123 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:45.035323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52340b9-da8c-40cc-8c0b-4c61bb8d3bd6 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:45.040395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 983/1979] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:45.044632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352efe69-5217-479e-849d-ed2962174123 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:45.054503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352efe69-5217-479e-849d-ed2962174123 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:45.060236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d9d9-7beb-4f65-ad43-9d0fe41ef806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:45.060903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d9d9-7beb-4f65-ad43-9d0fe41ef806 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:45.061185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d9d9-7beb-4f65-ad43-9d0fe41ef806 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:45.061477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d9d9-7beb-4f65-ad43-9d0fe41ef806 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:45.062177 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58d9d9-7beb-4f65-ad43-9d0fe41ef806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:45.063824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58d9d9-7beb-4f65-ad43-9d0fe41ef806 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:45.074381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 984/1980] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:45.078773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d9d9-7beb-4f65-ad43-9d0fe41ef806 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:45.089931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d9d9-7beb-4f65-ad43-9d0fe41ef806 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:45.091589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52340b9-da8c-40cc-8c0b-4c61bb8d3bd6 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:45.095190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315644a-5cfb-4b55-908f-480b878756ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:45.095861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785fbc9-d466-40ad-b931-338ea269cbde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:45.096329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315644a-5cfb-4b55-908f-480b878756ff admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:45.096655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785fbc9-d466-40ad-b931-338ea269cbde service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:45.096765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315644a-5cfb-4b55-908f-480b878756ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:45.097050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785fbc9-d466-40ad-b931-338ea269cbde service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:45.097141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315644a-5cfb-4b55-908f-480b878756ff admin admin] PATH_INFO: `/v3/projects/2e262b4dafbe4a5a8e1d6a0433fdc75e/users/671371f5bec94b6b8d4404697e8a6f7f/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:45.097470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785fbc9-d466-40ad-b931-338ea269cbde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:45.108172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785fbc9-d466-40ad-b931-338ea269cbde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:45.109712 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785fbc9-d466-40ad-b931-338ea269cbde service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:45.116785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315644a-5cfb-4b55-908f-480b878756ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e262b4dafbe4a5a8e1d6a0433fdc75e, user_id=671371f5bec94b6b8d4404697e8a6f7f, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:45.120907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315644a-5cfb-4b55-908f-480b878756ff admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:45.121413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 997/1981] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:45.126348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:45.176174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:45.225634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785fbc9-d466-40ad-b931-338ea269cbde service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:45.235076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785fbc9-d466-40ad-b931-338ea269cbde service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:45.238761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 985/1982] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:45 2022] PUT /identity/v3/projects/2e262b4dafbe4a5a8e1d6a0433fdc75e/users/671371f5bec94b6b8d4404697e8a6f7f/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:45.249922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32812b57-e4f9-4f54-9888-2200251c05c8 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:45.250220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32812b57-e4f9-4f54-9888-2200251c05c8 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:45.250608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32812b57-e4f9-4f54-9888-2200251c05c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:45.278690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-32812b57-e4f9-4f54-9888-2200251c05c8 None None] MFA Rules not processed for user `671371f5bec94b6b8d4404697e8a6f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:45.279932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-32812b57-e4f9-4f54-9888-2200251c05c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:45.303952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151acc4-3404-4e54-a3a2-efcd834184f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:45.304705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151acc4-3404-4e54-a3a2-efcd834184f6 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:45.305057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151acc4-3404-4e54-a3a2-efcd834184f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:45.305455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151acc4-3404-4e54-a3a2-efcd834184f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:45.308542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d151acc4-3404-4e54-a3a2-efcd834184f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:45.353904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 986/1983] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:45.358279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32812b57-e4f9-4f54-9888-2200251c05c8 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:45.372288 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151acc4-3404-4e54-a3a2-efcd834184f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:45.373841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151acc4-3404-4e54-a3a2-efcd834184f6 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:45.382823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 998/1984] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:45.424721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32812b57-e4f9-4f54-9888-2200251c05c8 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:45.431553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94047905-c3d2-46e6-b7dc-5c5e2168dcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:45.432429 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94047905-c3d2-46e6-b7dc-5c5e2168dcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:45.437945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94047905-c3d2-46e6-b7dc-5c5e2168dcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:45.437945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94047905-c3d2-46e6-b7dc-5c5e2168dcf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:45.437945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94047905-c3d2-46e6-b7dc-5c5e2168dcf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:45.438567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94047905-c3d2-46e6-b7dc-5c5e2168dcf4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:45.557007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 987/1985] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:45 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:45.558882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151acc4-3404-4e54-a3a2-efcd834184f6 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:45.570019 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151acc4-3404-4e54-a3a2-efcd834184f6 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:45.635066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff4203-bab6-4f03-bcda-09a11eae4b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:45.635786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4203-bab6-4f03-bcda-09a11eae4b1f admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:45.636069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4203-bab6-4f03-bcda-09a11eae4b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:45.636345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4203-bab6-4f03-bcda-09a11eae4b1f admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:45.637031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff4203-bab6-4f03-bcda-09a11eae4b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:45.638966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff4203-bab6-4f03-bcda-09a11eae4b1f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:45.768466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 999/1986] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:45 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:45.772264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94047905-c3d2-46e6-b7dc-5c5e2168dcf4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:45.782859 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94047905-c3d2-46e6-b7dc-5c5e2168dcf4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:45.787463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22e3eb-6c0f-4807-8dc1-08480b91bc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:45.788119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22e3eb-6c0f-4807-8dc1-08480b91bc1b admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:45.788403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22e3eb-6c0f-4807-8dc1-08480b91bc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:45.788680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22e3eb-6c0f-4807-8dc1-08480b91bc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:45.789388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22e3eb-6c0f-4807-8dc1-08480b91bc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:45.790968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22e3eb-6c0f-4807-8dc1-08480b91bc1b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:45.801391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 988/1987] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:45.805720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff4203-bab6-4f03-bcda-09a11eae4b1f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:45.826453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff4203-bab6-4f03-bcda-09a11eae4b1f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:45.831444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfecb5-0154-486f-802e-ff689cb3c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:45.832380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfecb5-0154-486f-802e-ff689cb3c791 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:45.832668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfecb5-0154-486f-802e-ff689cb3c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:45.832981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfecb5-0154-486f-802e-ff689cb3c791 admin admin] PATH_INFO: `/v3/projects/bef19678ebf94ddf99a480f7ea41fa3b/users/467f21226e6a413cb3ea5627003f8bd3/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:45.853854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfecb5-0154-486f-802e-ff689cb3c791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef19678ebf94ddf99a480f7ea41fa3b, user_id=467f21226e6a413cb3ea5627003f8bd3, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:45.856644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfecb5-0154-486f-802e-ff689cb3c791 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:45.889635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:45.935220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1000/1988] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:45 2022] PUT /identity/v3/projects/bef19678ebf94ddf99a480f7ea41fa3b/users/467f21226e6a413cb3ea5627003f8bd3/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:45.940219 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22e3eb-6c0f-4807-8dc1-08480b91bc1b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:45.951326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22e3eb-6c0f-4807-8dc1-08480b91bc1b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:45.952687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:46.006379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9894ec5-de96-4fe8-a892-b27d898fe648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:46.007083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9894ec5-de96-4fe8-a892-b27d898fe648 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:46.007388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9894ec5-de96-4fe8-a892-b27d898fe648 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:46.007669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9894ec5-de96-4fe8-a892-b27d898fe648 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:46.008474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9894ec5-de96-4fe8-a892-b27d898fe648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:46.010256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9894ec5-de96-4fe8-a892-b27d898fe648 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:46.020216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 989/1989] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:46.024823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfecb5-0154-486f-802e-ff689cb3c791 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:46.041024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfecb5-0154-486f-802e-ff689cb3c791 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:46.041631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492dcc1-d751-4902-8bf9-44f23584e086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:46.046667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492dcc1-d751-4902-8bf9-44f23584e086 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:46.046957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492dcc1-d751-4902-8bf9-44f23584e086 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:46.047237 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492dcc1-d751-4902-8bf9-44f23584e086 admin admin] PATH_INFO: `/v3/projects/bef19678ebf94ddf99a480f7ea41fa3b/users/467f21226e6a413cb3ea5627003f8bd3/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:46.049319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492dcc1-d751-4902-8bf9-44f23584e086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef19678ebf94ddf99a480f7ea41fa3b, user_id=467f21226e6a413cb3ea5627003f8bd3, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:46.052103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492dcc1-d751-4902-8bf9-44f23584e086 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:46.063760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1001/1990] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:46 2022] PUT /identity/v3/projects/bef19678ebf94ddf99a480f7ea41fa3b/users/467f21226e6a413cb3ea5627003f8bd3/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:46.074736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58c1c3-e013-45b7-9c09-0648d6456a0c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:46.075268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58c1c3-e013-45b7-9c09-0648d6456a0c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:46.075426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58c1c3-e013-45b7-9c09-0648d6456a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:46.104866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-fe58c1c3-e013-45b7-9c09-0648d6456a0c None None] MFA Rules not processed for user `467f21226e6a413cb3ea5627003f8bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:46.106141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-fe58c1c3-e013-45b7-9c09-0648d6456a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:46.122645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492dcc1-d751-4902-8bf9-44f23584e086 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:46.179568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 990/1991] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:46.193364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58c1c3-e013-45b7-9c09-0648d6456a0c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:46.210013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492dcc1-d751-4902-8bf9-44f23584e086 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:46.218664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:46.219680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:46.219963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:46.220238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] PATH_INFO: `/v3/users/2930bcc7295e4569a5211e93233eb362` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:46.221451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2930bcc7295e4569a5211e93233eb362)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:46.223451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:46.253770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58c1c3-e013-45b7-9c09-0648d6456a0c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:46.257653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17450d-98c3-4122-9443-9bac553eb45a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:46.258479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17450d-98c3-4122-9443-9bac553eb45a service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:46.258753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17450d-98c3-4122-9443-9bac553eb45a service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:46.262590 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17450d-98c3-4122-9443-9bac553eb45a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:46.319263 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17450d-98c3-4122-9443-9bac553eb45a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:46.320761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17450d-98c3-4122-9443-9bac553eb45a service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:46.330200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 991/1992] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:46.449906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:46.464813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2930bcc7295e4569a5211e93233eb362'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:46.476952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2930bcc7295e4569a5211e93233eb362'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:46.620855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2930bcc7295e4569a5211e93233eb362'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:46.629091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2930bcc7295e4569a5211e93233eb362'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:46.629892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2930bcc7295e4569a5211e93233eb362'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:46.637828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1002/1993] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:46 2022] DELETE /identity/v3/users/2930bcc7295e4569a5211e93233eb362 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:46.642747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569800e-760c-47a0-944a-11b1a51bf987 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:46.643035 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569800e-760c-47a0-944a-11b1a51bf987 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:46.643313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569800e-760c-47a0-944a-11b1a51bf987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:46.661969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-a569800e-760c-47a0-944a-11b1a51bf987 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:46.663154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a569800e-760c-47a0-944a-11b1a51bf987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:46.711449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:46.722316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 992/1994] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:46.732874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:46.734351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:46.795041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d9dd-eb63-4401-b006-3f22bd633daf admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:46.798819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb04f96-30f5-4e53-8f14-526c24fe0ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:46.801163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb04f96-30f5-4e53-8f14-526c24fe0ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:46.801163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb04f96-30f5-4e53-8f14-526c24fe0ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:46.801163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb04f96-30f5-4e53-8f14-526c24fe0ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:46.810791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb04f96-30f5-4e53-8f14-526c24fe0ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:46.812273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb04f96-30f5-4e53-8f14-526c24fe0ef8 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:46.823739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1003/1995] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:47.119889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:47.295294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569800e-760c-47a0-944a-11b1a51bf987 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:47.297156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a569800e-760c-47a0-944a-11b1a51bf987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:47.311867 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569800e-760c-47a0-944a-11b1a51bf987 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:47.318026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:47.319241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:47.319569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:47.319865 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] PATH_INFO: `/v3/projects/11d26bc5afa8454eba9ff929d5334a94` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:47.321236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d26bc5afa8454eba9ff929d5334a94)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:47.323336 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:47.426825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=3,keystone:INSERT=8 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:47.444631 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d26bc5afa8454eba9ff929d5334a94', 'request_id': 'req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:47.451369 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d26bc5afa8454eba9ff929d5334a94', 'request_id': 'req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:47.457094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d26bc5afa8454eba9ff929d5334a94', 'request_id': 'req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:47.597531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] The token cache is being invalidate because project 11d26bc5afa8454eba9ff929d5334a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:47.597882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:47.598514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:47.600113 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 993/1996] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:47 2022] DELETE /identity/v3/projects/11d26bc5afa8454eba9ff929d5334a94 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:47.604894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb04f96-30f5-4e53-8f14-526c24fe0ef8 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:47.614532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb04f96-30f5-4e53-8f14-526c24fe0ef8 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:47.621199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:47.676778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:47.677669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:47.678284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:47.678639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] PATH_INFO: `/v3/users/70314aef896647d895fca35d15fc8b31` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:47.680371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] RBAC: Authorizing `identity:delete_user(user_id=70314aef896647d895fca35d15fc8b31)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:47.682510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:47.898285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70314aef896647d895fca35d15fc8b31'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:47.913021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70314aef896647d895fca35d15fc8b31'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:47.986528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70314aef896647d895fca35d15fc8b31'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:47.996089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70314aef896647d895fca35d15fc8b31'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:47.996779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ee9a9964-7a6e-4d6c-96db-ae111773728b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70314aef896647d895fca35d15fc8b31'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:48.003227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1004/1997] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:47 2022] DELETE /identity/v3/users/70314aef896647d895fca35d15fc8b31 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:48.135557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:48.203967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:48.530168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:48.628836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:48.630393 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:48.654668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0cd10-3cb7-413f-9c83-f8b793e1ad8c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:48.673501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:48.713760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:48.714662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:48.714992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:48.715282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] PATH_INFO: `/v3/projects/614640f3e36449fc9bbefc5458d849e0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:48.717281 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=614640f3e36449fc9bbefc5458d849e0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:48.719052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:48.886957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614640f3e36449fc9bbefc5458d849e0', 'request_id': 'req-9e5994a5-59fd-4283-885b-df529b461430'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:48.893651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614640f3e36449fc9bbefc5458d849e0', 'request_id': 'req-9e5994a5-59fd-4283-885b-df529b461430'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:48.899620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614640f3e36449fc9bbefc5458d849e0', 'request_id': 'req-9e5994a5-59fd-4283-885b-df529b461430'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:49.015439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] The token cache is being invalidate because project 614640f3e36449fc9bbefc5458d849e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:49.015746 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:49.016414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9e5994a5-59fd-4283-885b-df529b461430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:49.018264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 994/1998] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:48 2022] DELETE /identity/v3/projects/614640f3e36449fc9bbefc5458d849e0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:49.023330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb8d82-5000-4ba9-a486-de012619e8a3 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:49.023675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb8d82-5000-4ba9-a486-de012619e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:49.023969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb8d82-5000-4ba9-a486-de012619e8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:49.046894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-5ffb8d82-5000-4ba9-a486-de012619e8a3 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:49.048161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-5ffb8d82-5000-4ba9-a486-de012619e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:49.108468 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1005/1999] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:49.117423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe718d-575c-45e9-b8cf-a3d36eb5d229 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:49.117712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe718d-575c-45e9-b8cf-a3d36eb5d229 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:49.117996 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe718d-575c-45e9-b8cf-a3d36eb5d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:49.139874 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5abe718d-575c-45e9-b8cf-a3d36eb5d229 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:49.141278 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5abe718d-575c-45e9-b8cf-a3d36eb5d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:49.153828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 995/2000] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:49.158246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb8d82-5000-4ba9-a486-de012619e8a3 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:49.168569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb8d82-5000-4ba9-a486-de012619e8a3 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:49.176271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef4766-1dcd-4a61-afe2-a5d6c7b3501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:49.176959 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef4766-1dcd-4a61-afe2-a5d6c7b3501d admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:49.177245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef4766-1dcd-4a61-afe2-a5d6c7b3501d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:49.177526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef4766-1dcd-4a61-afe2-a5d6c7b3501d admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:49.178842 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef4766-1dcd-4a61-afe2-a5d6c7b3501d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:49.179737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef4766-1dcd-4a61-afe2-a5d6c7b3501d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:49.182946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef4766-1dcd-4a61-afe2-a5d6c7b3501d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:49.195944 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1006/2001] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:49.201180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe718d-575c-45e9-b8cf-a3d36eb5d229 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:49.210773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe718d-575c-45e9-b8cf-a3d36eb5d229 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:49.215828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36e05-4b1d-4b9d-86e8-66c8c70a6b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:49.217554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36e05-4b1d-4b9d-86e8-66c8c70a6b4b admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:49.217554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36e05-4b1d-4b9d-86e8-66c8c70a6b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:49.217554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36e05-4b1d-4b9d-86e8-66c8c70a6b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:49.217828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36e05-4b1d-4b9d-86e8-66c8c70a6b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:49.219814 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36e05-4b1d-4b9d-86e8-66c8c70a6b4b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:49.343227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:49.350512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 996/2002] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:49 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:49.354756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef4766-1dcd-4a61-afe2-a5d6c7b3501d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:49.369622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef4766-1dcd-4a61-afe2-a5d6c7b3501d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:49.437545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a449c52-e6b2-4979-9007-7a0462baf1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:49.438403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a449c52-e6b2-4979-9007-7a0462baf1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:49.438695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a449c52-e6b2-4979-9007-7a0462baf1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:49.438977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a449c52-e6b2-4979-9007-7a0462baf1c4 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:49.439704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a449c52-e6b2-4979-9007-7a0462baf1c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:49.441726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a449c52-e6b2-4979-9007-7a0462baf1c4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:49.569232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1007/2003] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:49 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:49.570447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36e05-4b1d-4b9d-86e8-66c8c70a6b4b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:49.582674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36e05-4b1d-4b9d-86e8-66c8c70a6b4b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:49.593695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e7792-1fac-4e6d-87df-888b6f991577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:49.593695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e7792-1fac-4e6d-87df-888b6f991577 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:49.593695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e7792-1fac-4e6d-87df-888b6f991577 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:49.593695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e7792-1fac-4e6d-87df-888b6f991577 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:49.594163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e7792-1fac-4e6d-87df-888b6f991577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:49.595541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e7792-1fac-4e6d-87df-888b6f991577 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:49.619692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 997/2004] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:49.625801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a449c52-e6b2-4979-9007-7a0462baf1c4 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:49.634555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a449c52-e6b2-4979-9007-7a0462baf1c4 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:49.644142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051bb1c-bd15-4329-9606-d315c83c0a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:49.648103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051bb1c-bd15-4329-9606-d315c83c0a9e admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:49.648103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051bb1c-bd15-4329-9606-d315c83c0a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:49.648103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051bb1c-bd15-4329-9606-d315c83c0a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:49.648103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051bb1c-bd15-4329-9606-d315c83c0a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:49.649757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051bb1c-bd15-4329-9606-d315c83c0a9e admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:49.664142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1008/2005] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:49.665411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e7792-1fac-4e6d-87df-888b6f991577 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:49.680014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e7792-1fac-4e6d-87df-888b6f991577 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:49.686837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c5e1d-abed-4732-91b6-41236714d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:49.687940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c5e1d-abed-4732-91b6-41236714d29e admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:49.688296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c5e1d-abed-4732-91b6-41236714d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:49.688572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c5e1d-abed-4732-91b6-41236714d29e admin admin] PATH_INFO: `/v3/projects/0fe2d59b16f44ee6b1fb1053d68c9a6a/users/014feddfd96a4c769c3610b458da7edc/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:49.704829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c5e1d-abed-4732-91b6-41236714d29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe2d59b16f44ee6b1fb1053d68c9a6a, user_id=014feddfd96a4c769c3610b458da7edc, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:49.708407 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c5e1d-abed-4732-91b6-41236714d29e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:49.778807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051bb1c-bd15-4329-9606-d315c83c0a9e admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:49.780916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a051bb1c-bd15-4329-9606-d315c83c0a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:49.795670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051bb1c-bd15-4329-9606-d315c83c0a9e admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:49.810214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 998/2006] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:49 2022] PUT /identity/v3/projects/0fe2d59b16f44ee6b1fb1053d68c9a6a/users/014feddfd96a4c769c3610b458da7edc/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:49.813362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0eca1-3ff7-4f26-815c-505b7160abea None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:49.813693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0eca1-3ff7-4f26-815c-505b7160abea None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:49.813984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0eca1-3ff7-4f26-815c-505b7160abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:49.834826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:49.857950 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-17a0eca1-3ff7-4f26-815c-505b7160abea None None] MFA Rules not processed for user `014feddfd96a4c769c3610b458da7edc`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:49.859682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-17a0eca1-3ff7-4f26-815c-505b7160abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:49.896498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:49.896758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:49.897109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:49.897476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] PATH_INFO: `/v3/users/671371f5bec94b6b8d4404697e8a6f7f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:49.899075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=671371f5bec94b6b8d4404697e8a6f7f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:49.902742 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:49.928469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:49.984516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 999/2007] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:49.984516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0eca1-3ff7-4f26-815c-505b7160abea None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:49.984516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-17a0eca1-3ff7-4f26-815c-505b7160abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:49.998602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0eca1-3ff7-4f26-815c-505b7160abea None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:50.006289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:50.008947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:50.008947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:50.008947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] PATH_INFO: `/v3/users/0b09b63297314dda81fa2f19f25d6601` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:50.010377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b09b63297314dda81fa2f19f25d6601)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:50.012537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:50.128850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671371f5bec94b6b8d4404697e8a6f7f'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:50.141722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671371f5bec94b6b8d4404697e8a6f7f'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:50.235056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b09b63297314dda81fa2f19f25d6601'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:50.237872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671371f5bec94b6b8d4404697e8a6f7f'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:50.249326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b09b63297314dda81fa2f19f25d6601'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:50.250477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671371f5bec94b6b8d4404697e8a6f7f'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:50.251718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671371f5bec94b6b8d4404697e8a6f7f'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:50.258527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1009/2008] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:49 2022] DELETE /identity/v3/users/671371f5bec94b6b8d4404697e8a6f7f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:50.260209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:50.261945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:50.330119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f6e57-14c9-4a55-848d-a28c003c71ad admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:50.334708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb453d-6881-48e4-927a-9537831c65b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:50.335398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb453d-6881-48e4-927a-9537831c65b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:50.335683 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb453d-6881-48e4-927a-9537831c65b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:50.335959 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb453d-6881-48e4-927a-9537831c65b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:50.336642 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb453d-6881-48e4-927a-9537831c65b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:50.339357 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb453d-6881-48e4-927a-9537831c65b5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:50.352313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b09b63297314dda81fa2f19f25d6601'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:50.353229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b09b63297314dda81fa2f19f25d6601'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:50.353947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9c98d4cf-38d9-406d-a176-92948d9ae8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b09b63297314dda81fa2f19f25d6601'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:50.374868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1000/2009] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:49 2022] DELETE /identity/v3/users/0b09b63297314dda81fa2f19f25d6601 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:50.376291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9ebc1-3795-4eae-9788-679416ee4619 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:50.376581 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9ebc1-3795-4eae-9788-679416ee4619 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:50.376961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9ebc1-3795-4eae-9788-679416ee4619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:50.396378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-91b9ebc1-3795-4eae-9788-679416ee4619 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:50.397573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-91b9ebc1-3795-4eae-9788-679416ee4619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:50.469255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1001/2010] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:50.470760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6871b-0b94-4b00-9635-cf249778e19d None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:50.471189 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6871b-0b94-4b00-9635-cf249778e19d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:50.473232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6871b-0b94-4b00-9635-cf249778e19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:50.495549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-3dc6871b-0b94-4b00-9635-cf249778e19d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:50.496970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1010/2011] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:50 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:50.497086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3dc6871b-0b94-4b00-9635-cf249778e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:50.497866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb453d-6881-48e4-927a-9537831c65b5 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:50.499686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-56bb453d-6881-48e4-927a-9537831c65b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:50.563967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb453d-6881-48e4-927a-9537831c65b5 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:50.567792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205f3f8-dfa2-47d9-a01d-324015443a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:50.568469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205f3f8-dfa2-47d9-a01d-324015443a8c service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:50.568751 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205f3f8-dfa2-47d9-a01d-324015443a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:50.569031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205f3f8-dfa2-47d9-a01d-324015443a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:50.573127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1002/2012] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:50.574021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6871b-0b94-4b00-9635-cf249778e19d None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:50.575280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3dc6871b-0b94-4b00-9635-cf249778e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:50.585754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205f3f8-dfa2-47d9-a01d-324015443a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:50.591190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205f3f8-dfa2-47d9-a01d-324015443a8c service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:50.591329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6871b-0b94-4b00-9635-cf249778e19d None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:50.593964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ad675-1d99-4cb0-953c-9fb0db638f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:50.594629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ad675-1d99-4cb0-953c-9fb0db638f49 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:50.594911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ad675-1d99-4cb0-953c-9fb0db638f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:50.595185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ad675-1d99-4cb0-953c-9fb0db638f49 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:50.595915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ad675-1d99-4cb0-953c-9fb0db638f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:50.597809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1011/2013] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:50.597978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ad675-1d99-4cb0-953c-9fb0db638f49 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:50.598602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205f3f8-dfa2-47d9-a01d-324015443a8c service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:50.607384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205f3f8-dfa2-47d9-a01d-324015443a8c service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:50.611519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083b049-0686-4e61-b149-94c55e554c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:50.613987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083b049-0686-4e61-b149-94c55e554c5d service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:50.613987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083b049-0686-4e61-b149-94c55e554c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:50.613987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083b049-0686-4e61-b149-94c55e554c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:50.625045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083b049-0686-4e61-b149-94c55e554c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:50.626473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083b049-0686-4e61-b149-94c55e554c5d service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:50.637109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1012/2014] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:50.731746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:50.839490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1003/2015] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:50 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:50.843578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083b049-0686-4e61-b149-94c55e554c5d service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:50.856949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083b049-0686-4e61-b149-94c55e554c5d service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:50.861693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4548a-8fbf-482b-9435-5f6a8aaa3214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:50.862352 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4548a-8fbf-482b-9435-5f6a8aaa3214 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:50.862634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4548a-8fbf-482b-9435-5f6a8aaa3214 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:50.862930 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4548a-8fbf-482b-9435-5f6a8aaa3214 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:50.864050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4548a-8fbf-482b-9435-5f6a8aaa3214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:50.865750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4548a-8fbf-482b-9435-5f6a8aaa3214 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:50.878135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1013/2016] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:50.880641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ad675-1d99-4cb0-953c-9fb0db638f49 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:50.891833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ad675-1d99-4cb0-953c-9fb0db638f49 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:50.896808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a28a8-9f33-460c-b715-a508dac8b641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:50.897850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a28a8-9f33-460c-b715-a508dac8b641 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:50.898164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a28a8-9f33-460c-b715-a508dac8b641 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:50.904623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a28a8-9f33-460c-b715-a508dac8b641 admin admin] PATH_INFO: `/v3/projects/42b7ccfd96ca49ca9dc266fc153be869/users/c0ea6cbb601b4c80897c01299b1b52f7/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:50.919366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a28a8-9f33-460c-b715-a508dac8b641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b7ccfd96ca49ca9dc266fc153be869, user_id=c0ea6cbb601b4c80897c01299b1b52f7, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:50.922177 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a28a8-9f33-460c-b715-a508dac8b641 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:50.999245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1004/2017] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:50 2022] PUT /identity/v3/projects/42b7ccfd96ca49ca9dc266fc153be869/users/c0ea6cbb601b4c80897c01299b1b52f7/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:51.004196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4548a-8fbf-482b-9435-5f6a8aaa3214 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:51.017126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4548a-8fbf-482b-9435-5f6a8aaa3214 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:51.083908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f908075-718a-4540-a740-251ad61d2982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:51.085400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f908075-718a-4540-a740-251ad61d2982 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:51.085695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f908075-718a-4540-a740-251ad61d2982 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:51.085976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f908075-718a-4540-a740-251ad61d2982 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:51.087129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f908075-718a-4540-a740-251ad61d2982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:51.089651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f908075-718a-4540-a740-251ad61d2982 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:51.092880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a28a8-9f33-460c-b715-a508dac8b641 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:51.286377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f47a28a8-9f33-460c-b715-a508dac8b641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:51.288651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1014/2018] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:51.289422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a28a8-9f33-460c-b715-a508dac8b641 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:51.289422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:51.289422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:51.289422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:51.290306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] PATH_INFO: `/v3/projects/2e262b4dafbe4a5a8e1d6a0433fdc75e` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:51.290306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e262b4dafbe4a5a8e1d6a0433fdc75e)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:51.290306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:51.291273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f908075-718a-4540-a740-251ad61d2982 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:51.291273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f908075-718a-4540-a740-251ad61d2982 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:51.295956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeae20-1cf9-4b24-b262-388c93f4b986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:51.296988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeae20-1cf9-4b24-b262-388c93f4b986 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:51.297318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeae20-1cf9-4b24-b262-388c93f4b986 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:51.297622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeae20-1cf9-4b24-b262-388c93f4b986 admin admin] PATH_INFO: `/v3/projects/42b7ccfd96ca49ca9dc266fc153be869/users/c0ea6cbb601b4c80897c01299b1b52f7/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:51.300326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeae20-1cf9-4b24-b262-388c93f4b986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b7ccfd96ca49ca9dc266fc153be869, user_id=c0ea6cbb601b4c80897c01299b1b52f7, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:51.303091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeae20-1cf9-4b24-b262-388c93f4b986 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:51.316329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1015/2019] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:51 2022] PUT /identity/v3/projects/42b7ccfd96ca49ca9dc266fc153be869/users/c0ea6cbb601b4c80897c01299b1b52f7/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:51.327903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbb993-2ced-4017-b761-612ab4980c18 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:51.360813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbb993-2ced-4017-b761-612ab4980c18 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:51.360813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbb993-2ced-4017-b761-612ab4980c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:51.360813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-0cbbb993-2ced-4017-b761-612ab4980c18 None None] MFA Rules not processed for user `c0ea6cbb601b4c80897c01299b1b52f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:51.360813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0cbbb993-2ced-4017-b761-612ab4980c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:51.430872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1016/2020] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:51.438572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbb993-2ced-4017-b761-612ab4980c18 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:51.439993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0cbbb993-2ced-4017-b761-612ab4980c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:51.550186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbb993-2ced-4017-b761-612ab4980c18 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:51.550186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d5462-f6bf-4c41-961c-2840d5fe5f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:51.550186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5462-f6bf-4c41-961c-2840d5fe5f39 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:51.550186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5462-f6bf-4c41-961c-2840d5fe5f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:51.550918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5462-f6bf-4c41-961c-2840d5fe5f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:51.550918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b76d5462-f6bf-4c41-961c-2840d5fe5f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:51.573453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d5462-f6bf-4c41-961c-2840d5fe5f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:51.574921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d5462-f6bf-4c41-961c-2840d5fe5f39 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:51.588193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1017/2021] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:51.588193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d5462-f6bf-4c41-961c-2840d5fe5f39 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:51.588544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b76d5462-f6bf-4c41-961c-2840d5fe5f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:51.639377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e262b4dafbe4a5a8e1d6a0433fdc75e', 'request_id': 'req-00cf9516-afb8-4572-8941-a0728ce2bbf7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:51.651203 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e262b4dafbe4a5a8e1d6a0433fdc75e', 'request_id': 'req-00cf9516-afb8-4572-8941-a0728ce2bbf7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:51.671422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e262b4dafbe4a5a8e1d6a0433fdc75e', 'request_id': 'req-00cf9516-afb8-4572-8941-a0728ce2bbf7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:51.672066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d5462-f6bf-4c41-961c-2840d5fe5f39 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:51.747918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:51.748792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:51.749104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:51.749383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] PATH_INFO: `/v3/projects/8d7d0100b4e64e9780aa128ddef097f9` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:51.751031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7d0100b4e64e9780aa128ddef097f9)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:51.753471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:51.860063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:51.904066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7d0100b4e64e9780aa128ddef097f9', 'request_id': 'req-9698d5d7-662a-40cf-8fef-8452be45fedf'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:51.910255 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7d0100b4e64e9780aa128ddef097f9', 'request_id': 'req-9698d5d7-662a-40cf-8fef-8452be45fedf'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:51.916493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7d0100b4e64e9780aa128ddef097f9', 'request_id': 'req-9698d5d7-662a-40cf-8fef-8452be45fedf'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:51.921245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] The token cache is being invalidate because project 2e262b4dafbe4a5a8e1d6a0433fdc75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:51.921245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:51.921245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:51.921245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1005/2022] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:51 2022] DELETE /identity/v3/projects/2e262b4dafbe4a5a8e1d6a0433fdc75e => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:51.924527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:51.925882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:51.939588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf9516-afb8-4572-8941-a0728ce2bbf7 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:51.999158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:52.000376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:52.000376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:52.000633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] PATH_INFO: `/v3/users/467f21226e6a413cb3ea5627003f8bd3` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:52.001844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=467f21226e6a413cb3ea5627003f8bd3)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:52.003830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:52.004568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] The token cache is being invalidate because project 8d7d0100b4e64e9780aa128ddef097f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:52.004919 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.005673 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.010619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1018/2023] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:51 2022] DELETE /identity/v3/projects/8d7d0100b4e64e9780aa128ddef097f9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:52.013900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:52.017552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:52.028451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698d5d7-662a-40cf-8fef-8452be45fedf admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:52.033365 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:52.034239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:52.034525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:52.034811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] PATH_INFO: `/v3/users/65aa3fdc2cec40a59877f62d4dabf3a9` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:52.036030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65aa3fdc2cec40a59877f62d4dabf3a9)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:52.037969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:52.215596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65aa3fdc2cec40a59877f62d4dabf3a9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.216693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467f21226e6a413cb3ea5627003f8bd3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.224260 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467f21226e6a413cb3ea5627003f8bd3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.228164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65aa3fdc2cec40a59877f62d4dabf3a9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.336160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467f21226e6a413cb3ea5627003f8bd3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.337056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467f21226e6a413cb3ea5627003f8bd3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.338698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467f21226e6a413cb3ea5627003f8bd3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.357796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1006/2024] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:51 2022] DELETE /identity/v3/users/467f21226e6a413cb3ea5627003f8bd3 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:52.421152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65aa3fdc2cec40a59877f62d4dabf3a9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.429471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65aa3fdc2cec40a59877f62d4dabf3a9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.430870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65aa3fdc2cec40a59877f62d4dabf3a9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:52.438367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1019/2025] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:52 2022] DELETE /identity/v3/users/65aa3fdc2cec40a59877f62d4dabf3a9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:52.764763 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:52.885292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:52.886856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:52.910472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:52.914924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:52.970745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db000465-f968-43d2-8c01-0fc8f608fcdf admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.011840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0f2cf-03f5-4757-a938-15afe618a4a1 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.017107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.018151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.018500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.018842 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] PATH_INFO: `/v3/projects/ceeb7dc372384ba9b69cb4104c5693e3` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.020271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceeb7dc372384ba9b69cb4104c5693e3)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.022265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.030470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.031343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.031647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.031916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] PATH_INFO: `/v3/projects/bef19678ebf94ddf99a480f7ea41fa3b` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.033094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef19678ebf94ddf99a480f7ea41fa3b)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.035180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.124280 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceeb7dc372384ba9b69cb4104c5693e3', 'request_id': 'req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:53.130694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceeb7dc372384ba9b69cb4104c5693e3', 'request_id': 'req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:53.135960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceeb7dc372384ba9b69cb4104c5693e3', 'request_id': 'req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:53.154157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef19678ebf94ddf99a480f7ea41fa3b', 'request_id': 'req-2310846b-aaaf-4137-8030-cd7a498471ed'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:53.160189 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef19678ebf94ddf99a480f7ea41fa3b', 'request_id': 'req-2310846b-aaaf-4137-8030-cd7a498471ed'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:53.165611 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef19678ebf94ddf99a480f7ea41fa3b', 'request_id': 'req-2310846b-aaaf-4137-8030-cd7a498471ed'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:53.243242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] The token cache is being invalidate because project ceeb7dc372384ba9b69cb4104c5693e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:53.243576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:53.244369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83f769c0-3d4d-4b31-a8e5-04245f8cb45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:53.245945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1020/2026] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:52 2022] DELETE /identity/v3/projects/ceeb7dc372384ba9b69cb4104c5693e3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:53.250566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ed2f7-6fc3-4b77-8209-a8c66a2a5178 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.250852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ed2f7-6fc3-4b77-8209-a8c66a2a5178 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.251132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ed2f7-6fc3-4b77-8209-a8c66a2a5178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.270567 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-aa8ed2f7-6fc3-4b77-8209-a8c66a2a5178 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:53.271924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-aa8ed2f7-6fc3-4b77-8209-a8c66a2a5178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:53.317470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] The token cache is being invalidate because project bef19678ebf94ddf99a480f7ea41fa3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:53.317760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:53.318526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2310846b-aaaf-4137-8030-cd7a498471ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:53.320437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1007/2027] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:52 2022] DELETE /identity/v3/projects/bef19678ebf94ddf99a480f7ea41fa3b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:53.326799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a14d6d-14fb-4ebd-a03f-fe7949de1545 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.327092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a14d6d-14fb-4ebd-a03f-fe7949de1545 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.327391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a14d6d-14fb-4ebd-a03f-fe7949de1545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.341536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1021/2028] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:53.350521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836d729-7f8c-40fa-bcd2-0d06f012b590 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.350813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836d729-7f8c-40fa-bcd2-0d06f012b590 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.351133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836d729-7f8c-40fa-bcd2-0d06f012b590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.355838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d7a14d6d-14fb-4ebd-a03f-fe7949de1545 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:53.360994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d7a14d6d-14fb-4ebd-a03f-fe7949de1545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:53.376351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1008/2029] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:53.376663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-4836d729-7f8c-40fa-bcd2-0d06f012b590 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:53.377910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4836d729-7f8c-40fa-bcd2-0d06f012b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:53.380197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5e698-dccd-452e-b7a4-5b3f91de88da None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.380584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5e698-dccd-452e-b7a4-5b3f91de88da None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.381055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5e698-dccd-452e-b7a4-5b3f91de88da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.387386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1022/2030] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:53.392823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836d729-7f8c-40fa-bcd2-0d06f012b590 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.403010 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836d729-7f8c-40fa-bcd2-0d06f012b590 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.406359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9da5e698-dccd-452e-b7a4-5b3f91de88da None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:53.407851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7b239-2c64-4b6d-a747-d9d157adf0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.408608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7b239-2c64-4b6d-a747-d9d157adf0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.408780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7b239-2c64-4b6d-a747-d9d157adf0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.409058 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7b239-2c64-4b6d-a747-d9d157adf0c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.409881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7b239-2c64-4b6d-a747-d9d157adf0c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:53.410181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7b239-2c64-4b6d-a747-d9d157adf0c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.411567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9da5e698-dccd-452e-b7a4-5b3f91de88da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:53.411974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7b239-2c64-4b6d-a747-d9d157adf0c6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.415278 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:53.422982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1009/2031] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:53.427266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1023/2032] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:52:53.430102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5e698-dccd-452e-b7a4-5b3f91de88da None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.430275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7b239-2c64-4b6d-a747-d9d157adf0c6 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.440001 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5e698-dccd-452e-b7a4-5b3f91de88da None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.440163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7b239-2c64-4b6d-a747-d9d157adf0c6 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.444570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a9988-7c5e-4e89-98cd-447a3f67a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.444726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f99cf6-69ef-4188-b47d-deeec1891484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.445224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a9988-7c5e-4e89-98cd-447a3f67a9dd admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.445334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f99cf6-69ef-4188-b47d-deeec1891484 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.445508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a9988-7c5e-4e89-98cd-447a3f67a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.445613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f99cf6-69ef-4188-b47d-deeec1891484 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.445845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f99cf6-69ef-4188-b47d-deeec1891484 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.445955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a9988-7c5e-4e89-98cd-447a3f67a9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.446529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f99cf6-69ef-4188-b47d-deeec1891484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.446630 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a9988-7c5e-4e89-98cd-447a3f67a9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:53.449105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f99cf6-69ef-4188-b47d-deeec1891484 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.449964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a9988-7c5e-4e89-98cd-447a3f67a9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.451371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a9988-7c5e-4e89-98cd-447a3f67a9dd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.464653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1010/2033] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:52:53.469076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a9988-7c5e-4e89-98cd-447a3f67a9dd admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.479088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a9988-7c5e-4e89-98cd-447a3f67a9dd admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.486945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a157b3f-a494-445f-863e-695c06efc2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.487628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a157b3f-a494-445f-863e-695c06efc2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.487909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a157b3f-a494-445f-863e-695c06efc2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.488184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a157b3f-a494-445f-863e-695c06efc2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.488872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a157b3f-a494-445f-863e-695c06efc2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.490763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a157b3f-a494-445f-863e-695c06efc2c4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.559683 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1024/2034] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:53 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:53.563704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:53.564853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f99cf6-69ef-4188-b47d-deeec1891484 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.626937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f99cf6-69ef-4188-b47d-deeec1891484 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.631797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687308d2-08ef-4d29-9137-9aee011a075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.632490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687308d2-08ef-4d29-9137-9aee011a075e admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.632774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687308d2-08ef-4d29-9137-9aee011a075e admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.633075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687308d2-08ef-4d29-9137-9aee011a075e admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.633761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687308d2-08ef-4d29-9137-9aee011a075e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.636504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687308d2-08ef-4d29-9137-9aee011a075e admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.652389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1011/2035] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:53 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:53.656198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a157b3f-a494-445f-863e-695c06efc2c4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.701524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1025/2036] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:53 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:53.705499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687308d2-08ef-4d29-9137-9aee011a075e admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.715731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687308d2-08ef-4d29-9137-9aee011a075e admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.720061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a157b3f-a494-445f-863e-695c06efc2c4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.720384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49219d-1866-4e62-9cca-1044d82d4363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.721034 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49219d-1866-4e62-9cca-1044d82d4363 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.721417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49219d-1866-4e62-9cca-1044d82d4363 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.721694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49219d-1866-4e62-9cca-1044d82d4363 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.722469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49219d-1866-4e62-9cca-1044d82d4363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.724114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49219d-1866-4e62-9cca-1044d82d4363 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.724970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2b85a-4af1-40a3-848d-24785388ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.725640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2b85a-4af1-40a3-848d-24785388ecdd admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.725923 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2b85a-4af1-40a3-848d-24785388ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.726200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2b85a-4af1-40a3-848d-24785388ecdd admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.726894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2b85a-4af1-40a3-848d-24785388ecdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.729038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2b85a-4af1-40a3-848d-24785388ecdd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.737593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1026/2037] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:53.738708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49219d-1866-4e62-9cca-1044d82d4363 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.748998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49219d-1866-4e62-9cca-1044d82d4363 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.753659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a516f-793b-474b-a677-50143bf80b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.754303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a516f-793b-474b-a677-50143bf80b09 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.754588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a516f-793b-474b-a677-50143bf80b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.754869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a516f-793b-474b-a677-50143bf80b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.755623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a516f-793b-474b-a677-50143bf80b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.757260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a516f-793b-474b-a677-50143bf80b09 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.774506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1027/2038] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:53.775750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a516f-793b-474b-a677-50143bf80b09 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.785587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a516f-793b-474b-a677-50143bf80b09 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.790265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4545d-0d6d-4026-b1d8-68b56b2604c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.791173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4545d-0d6d-4026-b1d8-68b56b2604c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.791484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4545d-0d6d-4026-b1d8-68b56b2604c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.791760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4545d-0d6d-4026-b1d8-68b56b2604c0 admin admin] PATH_INFO: `/v3/projects/7c7a93b8dd924c16a8cbd198cd937dc6/users/3a8d78dc909e4f7c8f03d07680dc5fe2/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.808169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4545d-0d6d-4026-b1d8-68b56b2604c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7a93b8dd924c16a8cbd198cd937dc6, user_id=3a8d78dc909e4f7c8f03d07680dc5fe2, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.810944 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1012/2039] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:53 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:53.811201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4545d-0d6d-4026-b1d8-68b56b2604c0 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.814969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2b85a-4af1-40a3-848d-24785388ecdd admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.825546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2b85a-4af1-40a3-848d-24785388ecdd admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.830347 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56438fd5-7135-48e9-92d0-b30091947019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.831159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56438fd5-7135-48e9-92d0-b30091947019 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.831471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56438fd5-7135-48e9-92d0-b30091947019 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.831748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56438fd5-7135-48e9-92d0-b30091947019 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.833152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56438fd5-7135-48e9-92d0-b30091947019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.835571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56438fd5-7135-48e9-92d0-b30091947019 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.846825 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1013/2040] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:53.850800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56438fd5-7135-48e9-92d0-b30091947019 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.861399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56438fd5-7135-48e9-92d0-b30091947019 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.866240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d25ea3-27d2-4495-9793-c4ca16e5a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.868383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25ea3-27d2-4495-9793-c4ca16e5a2da admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.868383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25ea3-27d2-4495-9793-c4ca16e5a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.868383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25ea3-27d2-4495-9793-c4ca16e5a2da admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.868383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d25ea3-27d2-4495-9793-c4ca16e5a2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.870707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d25ea3-27d2-4495-9793-c4ca16e5a2da admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:53.881525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1014/2041] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:53.886366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d25ea3-27d2-4495-9793-c4ca16e5a2da admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:53.896013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1028/2042] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:53 2022] PUT /identity/v3/projects/7c7a93b8dd924c16a8cbd198cd937dc6/users/3a8d78dc909e4f7c8f03d07680dc5fe2/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:53.897035 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d25ea3-27d2-4495-9793-c4ca16e5a2da admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:53.906870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db3b1f-06d7-4581-8e05-e3389a17d6b9 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.907319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db3b1f-06d7-4581-8e05-e3389a17d6b9 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.907740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db3b1f-06d7-4581-8e05-e3389a17d6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.937583 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-70db3b1f-06d7-4581-8e05-e3389a17d6b9 None None] MFA Rules not processed for user `3a8d78dc909e4f7c8f03d07680dc5fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:53.938794 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-70db3b1f-06d7-4581-8e05-e3389a17d6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:53.957810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc1fb0-d918-4e3c-bc34-38206932405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:53.960300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc1fb0-d918-4e3c-bc34-38206932405e admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:53.960300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc1fb0-d918-4e3c-bc34-38206932405e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:53.960300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc1fb0-d918-4e3c-bc34-38206932405e admin admin] PATH_INFO: `/v3/projects/25f8de28a0664821af43d9cdccab292d/users/f571731515754890874b862a1407ebc0/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:53.975487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc1fb0-d918-4e3c-bc34-38206932405e admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f8de28a0664821af43d9cdccab292d, user_id=f571731515754890874b862a1407ebc0, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:53.978679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc1fb0-d918-4e3c-bc34-38206932405e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:54.012313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1029/2043] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:54.016763 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db3b1f-06d7-4581-8e05-e3389a17d6b9 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:54.029524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db3b1f-06d7-4581-8e05-e3389a17d6b9 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:54.034469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a40f9-c8fa-4cf8-ad4f-d474aebf5cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:54.035196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a40f9-c8fa-4cf8-ad4f-d474aebf5cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:54.035517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a40f9-c8fa-4cf8-ad4f-d474aebf5cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:54.035802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a40f9-c8fa-4cf8-ad4f-d474aebf5cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:54.036503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a40f9-c8fa-4cf8-ad4f-d474aebf5cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:54.038453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a40f9-c8fa-4cf8-ad4f-d474aebf5cf5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:54.110049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1015/2044] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:53 2022] PUT /identity/v3/projects/25f8de28a0664821af43d9cdccab292d/users/f571731515754890874b862a1407ebc0/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:52:54.116529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0ee61-ca16-48bf-a1c3-246904110830 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:54.117081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0ee61-ca16-48bf-a1c3-246904110830 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:54.117538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0ee61-ca16-48bf-a1c3-246904110830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:54.130786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:54.147084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-1ed0ee61-ca16-48bf-a1c3-246904110830 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:54.148329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1ed0ee61-ca16-48bf-a1c3-246904110830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:54.208379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1016/2045] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:54.220158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0ee61-ca16-48bf-a1c3-246904110830 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:54.227060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1ed0ee61-ca16-48bf-a1c3-246904110830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:54.227187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1030/2046] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:54 2022] POST /identity/v3/projects => generated 389 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:54.228441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a40f9-c8fa-4cf8-ad4f-d474aebf5cf5 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:54.280396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0ee61-ca16-48bf-a1c3-246904110830 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:54.295514 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a40f9-c8fa-4cf8-ad4f-d474aebf5cf5 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:54.300374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944826e5-d6fc-4c1a-97f9-846156584fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:54.301054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944826e5-d6fc-4c1a-97f9-846156584fac admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:54.301337 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944826e5-d6fc-4c1a-97f9-846156584fac admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:54.301613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944826e5-d6fc-4c1a-97f9-846156584fac admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:54.302311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944826e5-d6fc-4c1a-97f9-846156584fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:54.304317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944826e5-d6fc-4c1a-97f9-846156584fac admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:54.334495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ded0a8-ee50-4e42-88a5-494931e9fdf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:54.335154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ded0a8-ee50-4e42-88a5-494931e9fdf7 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:54.335470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ded0a8-ee50-4e42-88a5-494931e9fdf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:54.335817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ded0a8-ee50-4e42-88a5-494931e9fdf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:54.346962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ded0a8-ee50-4e42-88a5-494931e9fdf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:54.348438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ded0a8-ee50-4e42-88a5-494931e9fdf7 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:54.359134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1017/2047] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:54.394743 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:54.401219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1031/2048] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:54 2022] POST /identity/v3/users => generated 301 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:54.406017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ded0a8-ee50-4e42-88a5-494931e9fdf7 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:54.419079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ded0a8-ee50-4e42-88a5-494931e9fdf7 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:54.435115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b4f12-dcce-45f1-b40c-3ab62460b88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:54.435115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b4f12-dcce-45f1-b40c-3ab62460b88e admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:54.435115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b4f12-dcce-45f1-b40c-3ab62460b88e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:54.435115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b4f12-dcce-45f1-b40c-3ab62460b88e admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:54.444143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b4f12-dcce-45f1-b40c-3ab62460b88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:54.444143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b4f12-dcce-45f1-b40c-3ab62460b88e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:54.444143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1018/2049] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:54.450658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944826e5-d6fc-4c1a-97f9-846156584fac admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:54.465466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944826e5-d6fc-4c1a-97f9-846156584fac admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:54.472276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845977-5334-42ef-80f4-dc7a3e6d88a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:54.473720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845977-5334-42ef-80f4-dc7a3e6d88a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:54.474200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845977-5334-42ef-80f4-dc7a3e6d88a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:54.474551 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845977-5334-42ef-80f4-dc7a3e6d88a3 admin admin] PATH_INFO: `/v3/projects/aa5f30709f374cf088455fb80d44cdaa/users/1c980af31d4249ddb2ccb0560e7a33a0/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:54.495183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9845977-5334-42ef-80f4-dc7a3e6d88a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5f30709f374cf088455fb80d44cdaa, user_id=1c980af31d4249ddb2ccb0560e7a33a0, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:54.497928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9845977-5334-42ef-80f4-dc7a3e6d88a3 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:54.607659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1032/2050] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:54 2022] PUT /identity/v3/projects/aa5f30709f374cf088455fb80d44cdaa/users/1c980af31d4249ddb2ccb0560e7a33a0/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:54.610860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b4f12-dcce-45f1-b40c-3ab62460b88e admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:54.627395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b4f12-dcce-45f1-b40c-3ab62460b88e admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:54.729707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792f651-f117-422f-b7a3-6e905f783784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:54.730649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792f651-f117-422f-b7a3-6e905f783784 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:54.731130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792f651-f117-422f-b7a3-6e905f783784 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:54.731513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792f651-f117-422f-b7a3-6e905f783784 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:54.732754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792f651-f117-422f-b7a3-6e905f783784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:54.734815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792f651-f117-422f-b7a3-6e905f783784 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:54.751381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1019/2051] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:52:54.752880 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845977-5334-42ef-80f4-dc7a3e6d88a3 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:54.764242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845977-5334-42ef-80f4-dc7a3e6d88a3 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:54.769563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085524f-d3dc-4b89-8f3b-0b1b9fcfdbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:54.770573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085524f-d3dc-4b89-8f3b-0b1b9fcfdbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:54.770925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085524f-d3dc-4b89-8f3b-0b1b9fcfdbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:54.771325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085524f-d3dc-4b89-8f3b-0b1b9fcfdbe2 admin admin] PATH_INFO: `/v3/projects/aa5f30709f374cf088455fb80d44cdaa/users/1c980af31d4249ddb2ccb0560e7a33a0/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:54.773520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085524f-d3dc-4b89-8f3b-0b1b9fcfdbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5f30709f374cf088455fb80d44cdaa, user_id=1c980af31d4249ddb2ccb0560e7a33a0, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:54.776248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085524f-d3dc-4b89-8f3b-0b1b9fcfdbe2 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:54.787906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1033/2052] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:54 2022] PUT /identity/v3/projects/aa5f30709f374cf088455fb80d44cdaa/users/1c980af31d4249ddb2ccb0560e7a33a0/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:54.799542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83a0b-3113-49f9-b5df-3f55a6fd8ceb None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:54.799826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83a0b-3113-49f9-b5df-3f55a6fd8ceb None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:54.800210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83a0b-3113-49f9-b5df-3f55a6fd8ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:54.830827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5bd83a0b-3113-49f9-b5df-3f55a6fd8ceb None None] MFA Rules not processed for user `1c980af31d4249ddb2ccb0560e7a33a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:54.832095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5bd83a0b-3113-49f9-b5df-3f55a6fd8ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:54.922063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1020/2053] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:54.933490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085524f-d3dc-4b89-8f3b-0b1b9fcfdbe2 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:54.935606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b085524f-d3dc-4b89-8f3b-0b1b9fcfdbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:55.000627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085524f-d3dc-4b89-8f3b-0b1b9fcfdbe2 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:55.006629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e93de-fffd-4aa5-b9e4-0f7dcbc1fff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:55.006629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e93de-fffd-4aa5-b9e4-0f7dcbc1fff0 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:55.006629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e93de-fffd-4aa5-b9e4-0f7dcbc1fff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:55.006629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e93de-fffd-4aa5-b9e4-0f7dcbc1fff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:55.016319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e93de-fffd-4aa5-b9e4-0f7dcbc1fff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:55.017758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e93de-fffd-4aa5-b9e4-0f7dcbc1fff0 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:55.027481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1034/2054] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:55.232122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83a0b-3113-49f9-b5df-3f55a6fd8ceb None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:55.325470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:55.378223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83a0b-3113-49f9-b5df-3f55a6fd8ceb None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:55.383808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:55.384905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:55.385283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:55.385678 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] PATH_INFO: `/v3/users/3a8d78dc909e4f7c8f03d07680dc5fe2` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:55.387022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8d78dc909e4f7c8f03d07680dc5fe2)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:55.389405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:55.592445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:55.692013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8d78dc909e4f7c8f03d07680dc5fe2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:55.701685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8d78dc909e4f7c8f03d07680dc5fe2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:55.809344 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8d78dc909e4f7c8f03d07680dc5fe2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:55.810271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8d78dc909e4f7c8f03d07680dc5fe2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:55.810876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8d78dc909e4f7c8f03d07680dc5fe2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:55.829829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1021/2055] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:55 2022] DELETE /identity/v3/users/3a8d78dc909e4f7c8f03d07680dc5fe2 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:55.834409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d2262-056a-427e-b1b9-84ae84604bdc None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:55.834702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d2262-056a-427e-b1b9-84ae84604bdc None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:55.834984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d2262-056a-427e-b1b9-84ae84604bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:55.852682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-755d2262-056a-427e-b1b9-84ae84604bdc None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:55.854047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-755d2262-056a-427e-b1b9-84ae84604bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:55.924186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1035/2056] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:55.936591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:55.940956 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:56.004875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f28f50-8434-43ff-853a-ed4f614524e1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:56.009279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d4a99-b64b-464a-94a1-231d1233062b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:56.010953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d4a99-b64b-464a-94a1-231d1233062b service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:56.011240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d4a99-b64b-464a-94a1-231d1233062b service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:56.011555 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d4a99-b64b-464a-94a1-231d1233062b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:56.021513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d4a99-b64b-464a-94a1-231d1233062b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:56.023003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d4a99-b64b-464a-94a1-231d1233062b service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:56.036356 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1022/2057] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:56.131527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaaab7-fef2-4e31-a5a7-d153964c8d84 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:56.132016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaaab7-fef2-4e31-a5a7-d153964c8d84 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:56.132726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaaab7-fef2-4e31-a5a7-d153964c8d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:56.171401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1abaaab7-fef2-4e31-a5a7-d153964c8d84 None None] MFA Rules not processed for user `f571731515754890874b862a1407ebc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:56.173057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1abaaab7-fef2-4e31-a5a7-d153964c8d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:56.270082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1036/2058] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:56.283632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d4a99-b64b-464a-94a1-231d1233062b service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:56.285043 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9b6d4a99-b64b-464a-94a1-231d1233062b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:56.375537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d4a99-b64b-464a-94a1-231d1233062b service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:56.375537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18935d9-fcea-452a-91e7-dd445af57bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:56.375537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18935d9-fcea-452a-91e7-dd445af57bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:56.375537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18935d9-fcea-452a-91e7-dd445af57bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:56.375909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18935d9-fcea-452a-91e7-dd445af57bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:56.385897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18935d9-fcea-452a-91e7-dd445af57bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:56.387402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18935d9-fcea-452a-91e7-dd445af57bb0 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:56.398607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1023/2059] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:52:56.696666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaaab7-fef2-4e31-a5a7-d153964c8d84 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:56.698932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1abaaab7-fef2-4e31-a5a7-d153964c8d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:56.720282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaaab7-fef2-4e31-a5a7-d153964c8d84 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:56.727388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:56.728780 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:56.729472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:56.730236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] PATH_INFO: `/v3/projects/7c7a93b8dd924c16a8cbd198cd937dc6` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:56.731619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7a93b8dd924c16a8cbd198cd937dc6)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:56.735061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:56.839752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:56.856624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7a93b8dd924c16a8cbd198cd937dc6', 'request_id': 'req-e88667c9-7256-406a-a58e-2b637d57b713'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:56.863068 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7a93b8dd924c16a8cbd198cd937dc6', 'request_id': 'req-e88667c9-7256-406a-a58e-2b637d57b713'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:56.869446 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7a93b8dd924c16a8cbd198cd937dc6', 'request_id': 'req-e88667c9-7256-406a-a58e-2b637d57b713'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:56.969102 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] The token cache is being invalidate because project 7c7a93b8dd924c16a8cbd198cd937dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:56.969399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:56.970038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:56.971649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1037/2060] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:56 2022] DELETE /identity/v3/projects/7c7a93b8dd924c16a8cbd198cd937dc6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:56.975741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18935d9-fcea-452a-91e7-dd445af57bb0 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:56.986819 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18935d9-fcea-452a-91e7-dd445af57bb0 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:57.048153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:57.049046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:57.049335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:57.049640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] PATH_INFO: `/v3/users/1c980af31d4249ddb2ccb0560e7a33a0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:57.050838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c980af31d4249ddb2ccb0560e7a33a0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:57.052825 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:57.267099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:57.361516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c980af31d4249ddb2ccb0560e7a33a0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:57.369611 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c980af31d4249ddb2ccb0560e7a33a0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:57.495861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c980af31d4249ddb2ccb0560e7a33a0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:57.496620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c980af31d4249ddb2ccb0560e7a33a0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:57.497789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ab589c4e-2a1e-4ea8-987d-92f6c090761c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c980af31d4249ddb2ccb0560e7a33a0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:57.534005 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1024/2061] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:52:56 2022] DELETE /identity/v3/users/1c980af31d4249ddb2ccb0560e7a33a0 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:57.993530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:57.995831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:58.013382 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88667c9-7256-406a-a58e-2b637d57b713 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:58.109865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:58.110826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:58.111109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:58.111407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] PATH_INFO: `/v3/projects/aa5f30709f374cf088455fb80d44cdaa` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:58.113523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa5f30709f374cf088455fb80d44cdaa)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:58.116410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:58.216290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:58.234643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa5f30709f374cf088455fb80d44cdaa', 'request_id': 'req-60eb580d-41f0-426b-9b10-d0dff7b7453d'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:58.240991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa5f30709f374cf088455fb80d44cdaa', 'request_id': 'req-60eb580d-41f0-426b-9b10-d0dff7b7453d'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:58.246479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa5f30709f374cf088455fb80d44cdaa', 'request_id': 'req-60eb580d-41f0-426b-9b10-d0dff7b7453d'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:58.381204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] The token cache is being invalidate because project aa5f30709f374cf088455fb80d44cdaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:52:58.381879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:58.382263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60eb580d-41f0-426b-9b10-d0dff7b7453d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:52:58.384676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1038/2062] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:52:57 2022] DELETE /identity/v3/projects/aa5f30709f374cf088455fb80d44cdaa => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:58.390004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15b7a9-fd9d-48ef-b0ad-809038234a5c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:58.390285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15b7a9-fd9d-48ef-b0ad-809038234a5c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:58.390557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15b7a9-fd9d-48ef-b0ad-809038234a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:58.410500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-bf15b7a9-fd9d-48ef-b0ad-809038234a5c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:58.411685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-bf15b7a9-fd9d-48ef-b0ad-809038234a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:58.502263 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1025/2063] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:58.506525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d747b-371e-4b7e-bc4b-a148fdfffbd0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:58.508223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d747b-371e-4b7e-bc4b-a148fdfffbd0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:58.508606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d747b-371e-4b7e-bc4b-a148fdfffbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:58.511174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71371158-3092-429f-b861-6d1c1b8a7244 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:58.511543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71371158-3092-429f-b861-6d1c1b8a7244 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:58.511946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71371158-3092-429f-b861-6d1c1b8a7244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:58.530940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-398d747b-371e-4b7e-bc4b-a148fdfffbd0 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:58.532486 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-398d747b-371e-4b7e-bc4b-a148fdfffbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:58.532656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-71371158-3092-429f-b861-6d1c1b8a7244 None None] MFA Rules not processed for user `f571731515754890874b862a1407ebc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:58.533839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-71371158-3092-429f-b861-6d1c1b8a7244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:58.545557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1039/2064] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:58.549536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d747b-371e-4b7e-bc4b-a148fdfffbd0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:58.559327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d747b-371e-4b7e-bc4b-a148fdfffbd0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:58.565984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078b557-690f-4014-8480-e6e65a327596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:58.566669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078b557-690f-4014-8480-e6e65a327596 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:58.566955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078b557-690f-4014-8480-e6e65a327596 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:58.567239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078b557-690f-4014-8480-e6e65a327596 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:58.568061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078b557-690f-4014-8480-e6e65a327596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:52:58.568376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078b557-690f-4014-8480-e6e65a327596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:58.570160 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078b557-690f-4014-8480-e6e65a327596 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:58.600134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1040/2065] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:52:58.603076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078b557-690f-4014-8480-e6e65a327596 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:58.614341 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:58.631703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078b557-690f-4014-8480-e6e65a327596 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:58.636646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f2b78-5d71-496e-bcef-2a6d7cb18bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:58.639466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2b78-5d71-496e-bcef-2a6d7cb18bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:58.639466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2b78-5d71-496e-bcef-2a6d7cb18bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:58.639466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2b78-5d71-496e-bcef-2a6d7cb18bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:58.640094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1026/2066] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:52:58.640206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f2b78-5d71-496e-bcef-2a6d7cb18bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:58.642149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f2b78-5d71-496e-bcef-2a6d7cb18bc5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:58.697383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71371158-3092-429f-b861-6d1c1b8a7244 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:58.698824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-71371158-3092-429f-b861-6d1c1b8a7244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:58.714064 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:58.775874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1041/2067] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:52:58 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:52:58.777658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f2b78-5d71-496e-bcef-2a6d7cb18bc5 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:58.795856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71371158-3092-429f-b861-6d1c1b8a7244 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:58.881144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed5af7-66a1-44d9-bed3-a8a6c303acfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:58.882102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5af7-66a1-44d9-bed3-a8a6c303acfb service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:58.882392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5af7-66a1-44d9-bed3-a8a6c303acfb service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:58.882687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed5af7-66a1-44d9-bed3-a8a6c303acfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:58.885691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-61ed5af7-66a1-44d9-bed3-a8a6c303acfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:58.902908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f2b78-5d71-496e-bcef-2a6d7cb18bc5 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:58.908303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e1e0-0a6c-4f32-a1a6-dc8c12fb8436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:58.909309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e1e0-0a6c-4f32-a1a6-dc8c12fb8436 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:58.909309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e1e0-0a6c-4f32-a1a6-dc8c12fb8436 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:58.909599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e1e0-0a6c-4f32-a1a6-dc8c12fb8436 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:58.910293 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8e1e0-0a6c-4f32-a1a6-dc8c12fb8436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:58.912411 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8e1e0-0a6c-4f32-a1a6-dc8c12fb8436 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:58.962282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed5af7-66a1-44d9-bed3-a8a6c303acfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:58.968003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed5af7-66a1-44d9-bed3-a8a6c303acfb service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:58.982240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1027/2068] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:52:59.104165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1042/2069] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:52:58 2022] POST /identity/v3/users => generated 288 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:52:59.108354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed5af7-66a1-44d9-bed3-a8a6c303acfb service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:59.121162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed5af7-66a1-44d9-bed3-a8a6c303acfb service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:59.126520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d16c5-5121-46e2-9601-64c4abc85f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:59.130410 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d16c5-5121-46e2-9601-64c4abc85f07 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:59.130698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d16c5-5121-46e2-9601-64c4abc85f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:59.130987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d16c5-5121-46e2-9601-64c4abc85f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:59.131750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d16c5-5121-46e2-9601-64c4abc85f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:59.138965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:52:59.145927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d16c5-5121-46e2-9601-64c4abc85f07 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:59.173381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1028/2070] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:59.174985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e1e0-0a6c-4f32-a1a6-dc8c12fb8436 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:59.190988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e1e0-0a6c-4f32-a1a6-dc8c12fb8436 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:59.204697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4bd8f-a0fe-4ab4-aa8b-df03c4570994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:59.206066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4bd8f-a0fe-4ab4-aa8b-df03c4570994 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:59.206418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4bd8f-a0fe-4ab4-aa8b-df03c4570994 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:59.206680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4bd8f-a0fe-4ab4-aa8b-df03c4570994 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:59.215202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4bd8f-a0fe-4ab4-aa8b-df03c4570994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:59.215202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4bd8f-a0fe-4ab4-aa8b-df03c4570994 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:59.231024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d16c5-5121-46e2-9601-64c4abc85f07 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:59.234481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1043/2071] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:52:59.243343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d16c5-5121-46e2-9601-64c4abc85f07 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:59.248371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549add7-0d6b-47ae-929a-aaab168431ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:59.249266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549add7-0d6b-47ae-929a-aaab168431ba admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:59.249578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549add7-0d6b-47ae-929a-aaab168431ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:59.249856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549add7-0d6b-47ae-929a-aaab168431ba admin admin] PATH_INFO: `/v3/projects/653fd7cdd0e240b181af741c9ecf38f8/users/88424473fe4441dab17cdf62ff0b9e72/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:59.271686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549add7-0d6b-47ae-929a-aaab168431ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=653fd7cdd0e240b181af741c9ecf38f8, user_id=88424473fe4441dab17cdf62ff0b9e72, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:59.274480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549add7-0d6b-47ae-929a-aaab168431ba admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:59.368119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1029/2072] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:52:59 2022] PUT /identity/v3/projects/653fd7cdd0e240b181af741c9ecf38f8/users/88424473fe4441dab17cdf62ff0b9e72/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:52:59.385336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c654a-ea4c-4724-b259-609fe12e9b0f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:59.386179 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c654a-ea4c-4724-b259-609fe12e9b0f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:59.386461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c654a-ea4c-4724-b259-609fe12e9b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:59.450839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-d11c654a-ea4c-4724-b259-609fe12e9b0f None None] MFA Rules not processed for user `88424473fe4441dab17cdf62ff0b9e72`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:52:59.452215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d11c654a-ea4c-4724-b259-609fe12e9b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:59.538750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1044/2073] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:52:59.554119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549add7-0d6b-47ae-929a-aaab168431ba admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:52:59.557802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b549add7-0d6b-47ae-929a-aaab168431ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:52:59.627161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549add7-0d6b-47ae-929a-aaab168431ba admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:52:59.631526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc51f1-6e62-458d-a33b-939d5ddfae40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:52:59.632179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc51f1-6e62-458d-a33b-939d5ddfae40 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:52:59.632460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc51f1-6e62-458d-a33b-939d5ddfae40 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:52:59.632735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc51f1-6e62-458d-a33b-939d5ddfae40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:52:59.641719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc51f1-6e62-458d-a33b-939d5ddfae40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:52:59.643147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc51f1-6e62-458d-a33b-939d5ddfae40 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:52:59.654089 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1030/2074] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:52:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:00.192923 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:00.270336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c654a-ea4c-4724-b259-609fe12e9b0f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:00.272272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d11c654a-ea4c-4724-b259-609fe12e9b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:00.344717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c654a-ea4c-4724-b259-609fe12e9b0f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:00.349941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:00.350954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:00.351242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:00.351551 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] PATH_INFO: `/v3/users/fb55dda3375d4b9dbbea89e45536f389` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:00.352775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb55dda3375d4b9dbbea89e45536f389)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:00.355314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:00.559112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:00.695574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb55dda3375d4b9dbbea89e45536f389'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:00.721909 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb55dda3375d4b9dbbea89e45536f389'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:00.824167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb55dda3375d4b9dbbea89e45536f389'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:00.834507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb55dda3375d4b9dbbea89e45536f389'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:00.835520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb55dda3375d4b9dbbea89e45536f389'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:00.843881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1045/2075] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:00 2022] DELETE /identity/v3/users/fb55dda3375d4b9dbbea89e45536f389 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:00.848692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016383e-df33-4840-a0c4-578b06e20632 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:00.849195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016383e-df33-4840-a0c4-578b06e20632 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:00.849302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016383e-df33-4840-a0c4-578b06e20632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:00.874306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-a016383e-df33-4840-a0c4-578b06e20632 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:00.876576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a016383e-df33-4840-a0c4-578b06e20632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:00.956477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1031/2076] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:00.970719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:00.973795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:01.054777 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513b5be-4d33-4519-adc1-3e52310b9861 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:01.060145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0d171-0906-4de2-9eb5-88448f2758e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:01.060805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d171-0906-4de2-9eb5-88448f2758e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:01.061089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d171-0906-4de2-9eb5-88448f2758e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:01.061368 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d171-0906-4de2-9eb5-88448f2758e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:01.072475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0d171-0906-4de2-9eb5-88448f2758e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:01.074098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0d171-0906-4de2-9eb5-88448f2758e4 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:01.085937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1046/2077] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:01.620959 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016383e-df33-4840-a0c4-578b06e20632 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:01.622835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a016383e-df33-4840-a0c4-578b06e20632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:01.657860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016383e-df33-4840-a0c4-578b06e20632 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:01.707094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:01.707094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:01.707094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:01.707094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] PATH_INFO: `/v3/projects/87fc2e69ae0e4aa2a89ff5a26cba5d06` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:01.709702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87fc2e69ae0e4aa2a89ff5a26cba5d06)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:01.715211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:01.811224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:01.959824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87fc2e69ae0e4aa2a89ff5a26cba5d06', 'request_id': 'req-5e2b898d-80a2-42ec-9180-5ca3c757a897'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:01.967076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87fc2e69ae0e4aa2a89ff5a26cba5d06', 'request_id': 'req-5e2b898d-80a2-42ec-9180-5ca3c757a897'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:01.972919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87fc2e69ae0e4aa2a89ff5a26cba5d06', 'request_id': 'req-5e2b898d-80a2-42ec-9180-5ca3c757a897'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:02.061045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] The token cache is being invalidate because project 87fc2e69ae0e4aa2a89ff5a26cba5d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:02.061338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:02.062040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:02.063643 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1032/2078] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:01 2022] DELETE /identity/v3/projects/87fc2e69ae0e4aa2a89ff5a26cba5d06 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:02.067784 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0d171-0906-4de2-9eb5-88448f2758e4 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:02.078056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0d171-0906-4de2-9eb5-88448f2758e4 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:02.146932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:02.147705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:02.147979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:02.148413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] PATH_INFO: `/v3/users/fb01e44bd5ba4e0d8d44257d26369165` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:02.149630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb01e44bd5ba4e0d8d44257d26369165)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:02.152213 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:02.448548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb01e44bd5ba4e0d8d44257d26369165'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:02.465131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb01e44bd5ba4e0d8d44257d26369165'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:02.496988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:02.554942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb01e44bd5ba4e0d8d44257d26369165'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:02.564395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb01e44bd5ba4e0d8d44257d26369165'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:02.565165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-83870966-55ad-4aef-b765-bb189fea1572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb01e44bd5ba4e0d8d44257d26369165'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:02.571711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1047/2079] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:02 2022] DELETE /identity/v3/users/fb01e44bd5ba4e0d8d44257d26369165 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:02.615244 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:03.247292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:03.249158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:03.264594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b898d-80a2-42ec-9180-5ca3c757a897 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:03.327999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:03.328887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:03.329182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:03.331329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] PATH_INFO: `/v3/projects/19e5d438c83d4778a0d03171cc0150fc` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:03.331329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e5d438c83d4778a0d03171cc0150fc)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:03.332671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:03.594835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e5d438c83d4778a0d03171cc0150fc', 'request_id': 'req-0de8d6ad-11c5-4008-b2e6-d91576a745bd'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:03.603119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e5d438c83d4778a0d03171cc0150fc', 'request_id': 'req-0de8d6ad-11c5-4008-b2e6-d91576a745bd'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:03.609932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e5d438c83d4778a0d03171cc0150fc', 'request_id': 'req-0de8d6ad-11c5-4008-b2e6-d91576a745bd'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:03.713096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] The token cache is being invalidate because project 19e5d438c83d4778a0d03171cc0150fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:03.714085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:03.715413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0de8d6ad-11c5-4008-b2e6-d91576a745bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:03.718468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1033/2080] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:03 2022] DELETE /identity/v3/projects/19e5d438c83d4778a0d03171cc0150fc => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:03.724074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11c51-5579-4374-933f-77d7a69d4267 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:03.724074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11c51-5579-4374-933f-77d7a69d4267 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:03.724517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11c51-5579-4374-933f-77d7a69d4267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:03.793514 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f5f11c51-5579-4374-933f-77d7a69d4267 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:03.794928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f5f11c51-5579-4374-933f-77d7a69d4267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:03.867099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1048/2081] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:03.870596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581d95-ed70-4c40-871b-8279ff2ab583 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:03.870898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581d95-ed70-4c40-871b-8279ff2ab583 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:03.871577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581d95-ed70-4c40-871b-8279ff2ab583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:03.892328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-a3581d95-ed70-4c40-871b-8279ff2ab583 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:03.893607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a3581d95-ed70-4c40-871b-8279ff2ab583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:03.922684 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1034/2082] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:03.928415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11c51-5579-4374-933f-77d7a69d4267 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:03.966126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11c51-5579-4374-933f-77d7a69d4267 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:03.976512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d425-440b-49c9-b22d-149818023c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:03.978760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d425-440b-49c9-b22d-149818023c43 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:03.979304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d425-440b-49c9-b22d-149818023c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:03.979831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d425-440b-49c9-b22d-149818023c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:03.981613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991d425-440b-49c9-b22d-149818023c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:53:03.982353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991d425-440b-49c9-b22d-149818023c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:03.986744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991d425-440b-49c9-b22d-149818023c43 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:04.016215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1049/2083] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:53:04.023869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581d95-ed70-4c40-871b-8279ff2ab583 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:04.042857 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581d95-ed70-4c40-871b-8279ff2ab583 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:04.050156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:04.052816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b633a-63d5-4527-82f8-2f933f4f1375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:04.053857 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b633a-63d5-4527-82f8-2f933f4f1375 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:04.055642 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b633a-63d5-4527-82f8-2f933f4f1375 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:04.056922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b633a-63d5-4527-82f8-2f933f4f1375 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:04.062222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b633a-63d5-4527-82f8-2f933f4f1375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:04.064133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b633a-63d5-4527-82f8-2f933f4f1375 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:04.237260 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1035/2084] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:04 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:04.238936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d425-440b-49c9-b22d-149818023c43 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:04.253633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d425-440b-49c9-b22d-149818023c43 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:04.346552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac6c3a-4da7-4144-8eab-7dbf93a4b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:04.347301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac6c3a-4da7-4144-8eab-7dbf93a4b156 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:04.347747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac6c3a-4da7-4144-8eab-7dbf93a4b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:04.348302 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac6c3a-4da7-4144-8eab-7dbf93a4b156 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:04.349188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac6c3a-4da7-4144-8eab-7dbf93a4b156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:04.351533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac6c3a-4da7-4144-8eab-7dbf93a4b156 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:04.441491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b633a-63d5-4527-82f8-2f933f4f1375 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:04.443565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-449b633a-63d5-4527-82f8-2f933f4f1375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:04.461183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b633a-63d5-4527-82f8-2f933f4f1375 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:04.466129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:04.471981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:04.471981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:04.471981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] PATH_INFO: `/v3/users/72e4c92b149c4dffbdeba414d8803bf8` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:04.471981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e4c92b149c4dffbdeba414d8803bf8)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:04.471981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:04.502356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1050/2085] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:04 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:53:04.506459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac6c3a-4da7-4144-8eab-7dbf93a4b156 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:04.516515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac6c3a-4da7-4144-8eab-7dbf93a4b156 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:04.521218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88904efc-cd36-4d3f-88a3-310c3d26cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:04.522150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88904efc-cd36-4d3f-88a3-310c3d26cda1 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:04.525535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88904efc-cd36-4d3f-88a3-310c3d26cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:04.526026 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88904efc-cd36-4d3f-88a3-310c3d26cda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:04.527114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88904efc-cd36-4d3f-88a3-310c3d26cda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:04.534367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88904efc-cd36-4d3f-88a3-310c3d26cda1 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:04.543406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1051/2086] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:53:04.547983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88904efc-cd36-4d3f-88a3-310c3d26cda1 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:04.560911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88904efc-cd36-4d3f-88a3-310c3d26cda1 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:04.566087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd6d06-9ebd-4406-9a9c-cfb1ddf0a3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:04.567252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6d06-9ebd-4406-9a9c-cfb1ddf0a3ea admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:04.567252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6d06-9ebd-4406-9a9c-cfb1ddf0a3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:04.567543 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6d06-9ebd-4406-9a9c-cfb1ddf0a3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:04.568316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd6d06-9ebd-4406-9a9c-cfb1ddf0a3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:04.570671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd6d06-9ebd-4406-9a9c-cfb1ddf0a3ea admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:04.583423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1052/2087] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:04.589384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd6d06-9ebd-4406-9a9c-cfb1ddf0a3ea admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:04.599932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd6d06-9ebd-4406-9a9c-cfb1ddf0a3ea admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:04.607873 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7563de5-8564-45f7-b2f1-8c5e56a4be6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:04.608859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7563de5-8564-45f7-b2f1-8c5e56a4be6b admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:04.609318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7563de5-8564-45f7-b2f1-8c5e56a4be6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:04.610316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7563de5-8564-45f7-b2f1-8c5e56a4be6b admin admin] PATH_INFO: `/v3/projects/f16d7f184d264adb88ce761ce5356a5b/users/94b6bd0ae98249bca84cd96c04fe4959/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:04.628315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7563de5-8564-45f7-b2f1-8c5e56a4be6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16d7f184d264adb88ce761ce5356a5b, user_id=94b6bd0ae98249bca84cd96c04fe4959, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:04.631088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7563de5-8564-45f7-b2f1-8c5e56a4be6b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:04.724946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1053/2088] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:04 2022] PUT /identity/v3/projects/f16d7f184d264adb88ce761ce5356a5b/users/94b6bd0ae98249bca84cd96c04fe4959/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:04.732805 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e4c92b149c4dffbdeba414d8803bf8'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:04.737290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeabe3b-ed39-4220-a8a2-7319acbe4290 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:04.737578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeabe3b-ed39-4220-a8a2-7319acbe4290 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:04.737873 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeabe3b-ed39-4220-a8a2-7319acbe4290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:04.740012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e4c92b149c4dffbdeba414d8803bf8'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:04.766274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-9eeabe3b-ed39-4220-a8a2-7319acbe4290 None None] MFA Rules not processed for user `94b6bd0ae98249bca84cd96c04fe4959`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:04.767731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9eeabe3b-ed39-4220-a8a2-7319acbe4290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:04.826653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e4c92b149c4dffbdeba414d8803bf8'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:04.827546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e4c92b149c4dffbdeba414d8803bf8'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:04.828413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e4c92b149c4dffbdeba414d8803bf8'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:04.849528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1054/2089] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:04.849528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeabe3b-ed39-4220-a8a2-7319acbe4290 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:04.850191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9eeabe3b-ed39-4220-a8a2-7319acbe4290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:04.852072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1036/2090] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:04 2022] DELETE /identity/v3/users/72e4c92b149c4dffbdeba414d8803bf8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:04.858967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:04.860561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:04.943479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e62cf-685e-49fb-8e01-48919943c674 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:04.943479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750edb6-06e3-4d89-b2e7-03d2a80f6241 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd039be6500e74ae3a6f30821c5c19a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:04.943479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750edb6-06e3-4d89-b2e7-03d2a80f6241 service glance] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:04.943479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750edb6-06e3-4d89-b2e7-03d2a80f6241 service glance] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:04.944069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750edb6-06e3-4d89-b2e7-03d2a80f6241 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:04.950946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeabe3b-ed39-4220-a8a2-7319acbe4290 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:05.026754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:05.028015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:05.028372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:05.028723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] PATH_INFO: `/v3/users/88424473fe4441dab17cdf62ff0b9e72` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:05.029074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750edb6-06e3-4d89-b2e7-03d2a80f6241 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:05.030110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88424473fe4441dab17cdf62ff0b9e72)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:05.030546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750edb6-06e3-4d89-b2e7-03d2a80f6241 service glance] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:05.032939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:05.041017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1037/2091] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:53:05.186798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750edb6-06e3-4d89-b2e7-03d2a80f6241 service glance] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:05.187930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c750edb6-06e3-4d89-b2e7-03d2a80f6241 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:05.204048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:05.207669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750edb6-06e3-4d89-b2e7-03d2a80f6241 service glance] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:05.214343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:05.214998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:05.215625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:05.215915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] PATH_INFO: `/v3/projects/63675a395d824db687bca143dc25c3b2` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:05.217312 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63675a395d824db687bca143dc25c3b2)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:05.219313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:05.307206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88424473fe4441dab17cdf62ff0b9e72'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.324726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88424473fe4441dab17cdf62ff0b9e72'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.356601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63675a395d824db687bca143dc25c3b2', 'request_id': 'req-5236bc1d-4060-46f1-b638-8ebb133af4b6'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.364077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63675a395d824db687bca143dc25c3b2', 'request_id': 'req-5236bc1d-4060-46f1-b638-8ebb133af4b6'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.372289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63675a395d824db687bca143dc25c3b2', 'request_id': 'req-5236bc1d-4060-46f1-b638-8ebb133af4b6'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.394427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88424473fe4441dab17cdf62ff0b9e72'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.406466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88424473fe4441dab17cdf62ff0b9e72'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.407567 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-79fa4166-af91-47c6-a098-1f1e223f3072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88424473fe4441dab17cdf62ff0b9e72'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.415993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1055/2092] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:04 2022] DELETE /identity/v3/users/88424473fe4441dab17cdf62ff0b9e72 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:05.420683 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda4424-5780-4324-a581-79414ff2d171 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:05.420979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda4424-5780-4324-a581-79414ff2d171 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:05.421265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda4424-5780-4324-a581-79414ff2d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:05.442180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-ffda4424-5780-4324-a581-79414ff2d171 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:05.443409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ffda4424-5780-4324-a581-79414ff2d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:05.512290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] The token cache is being invalidate because project 63675a395d824db687bca143dc25c3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:05.512775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.513486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5236bc1d-4060-46f1-b638-8ebb133af4b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.519538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1038/2093] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:05 2022] DELETE /identity/v3/projects/63675a395d824db687bca143dc25c3b2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:05.521571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b90a78-5c94-4848-9da7-1a5a0eee5feb None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:05.522087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b90a78-5c94-4848-9da7-1a5a0eee5feb None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:05.522506 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b90a78-5c94-4848-9da7-1a5a0eee5feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:05.523311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1056/2094] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:05.534165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda4424-5780-4324-a581-79414ff2d171 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:05.536632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ffda4424-5780-4324-a581-79414ff2d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:05.549349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d9b90a78-5c94-4848-9da7-1a5a0eee5feb None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:05.550558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d9b90a78-5c94-4848-9da7-1a5a0eee5feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:05.560400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1039/2095] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:05.568112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b79bc1-95fe-4ad3-893e-5efde3d8b0e5 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:05.568399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b79bc1-95fe-4ad3-893e-5efde3d8b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:05.568851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b79bc1-95fe-4ad3-893e-5efde3d8b0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:05.588781 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-45b79bc1-95fe-4ad3-893e-5efde3d8b0e5 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:05.590341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-45b79bc1-95fe-4ad3-893e-5efde3d8b0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:05.602320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1040/2096] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:05.604315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b79bc1-95fe-4ad3-893e-5efde3d8b0e5 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:05.614079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b79bc1-95fe-4ad3-893e-5efde3d8b0e5 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:05.615267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda4424-5780-4324-a581-79414ff2d171 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:05.619094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cbd3c-c81c-4ae0-b5ad-cdf517a7dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:05.619941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbd3c-c81c-4ae0-b5ad-cdf517a7dcaa admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:05.620079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc04cd7-3ec3-48ef-bd05-2ddfb40054b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:05.620220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbd3c-c81c-4ae0-b5ad-cdf517a7dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:05.620697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbd3c-c81c-4ae0-b5ad-cdf517a7dcaa admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:05.620811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc04cd7-3ec3-48ef-bd05-2ddfb40054b3 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:05.621160 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc04cd7-3ec3-48ef-bd05-2ddfb40054b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:05.621750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc04cd7-3ec3-48ef-bd05-2ddfb40054b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:05.622013 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cbd3c-c81c-4ae0-b5ad-cdf517a7dcaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:53:05.622743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cbd3c-c81c-4ae0-b5ad-cdf517a7dcaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:05.624798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360cbd3c-c81c-4ae0-b5ad-cdf517a7dcaa admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:05.633389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc04cd7-3ec3-48ef-bd05-2ddfb40054b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:05.635277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc04cd7-3ec3-48ef-bd05-2ddfb40054b3 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:05.638582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1041/2097] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:53:05.639905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cbd3c-c81c-4ae0-b5ad-cdf517a7dcaa admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:05.641602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-360cbd3c-c81c-4ae0-b5ad-cdf517a7dcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:05.649559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1057/2098] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:53:05.651311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc04cd7-3ec3-48ef-bd05-2ddfb40054b3 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:05.656668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cbd3c-c81c-4ae0-b5ad-cdf517a7dcaa admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:05.662248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc04cd7-3ec3-48ef-bd05-2ddfb40054b3 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:05.662697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:05.663609 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:05.663892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:05.664156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] PATH_INFO: `/v3/users/014feddfd96a4c769c3610b458da7edc` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:05.666188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014feddfd96a4c769c3610b458da7edc)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:05.668430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:05.670413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebc74f-e93c-4788-a30e-b208173d8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:05.671084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc74f-e93c-4788-a30e-b208173d8845 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:05.671390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc74f-e93c-4788-a30e-b208173d8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:05.671676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc74f-e93c-4788-a30e-b208173d8845 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:05.672525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebc74f-e93c-4788-a30e-b208173d8845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:05.675134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebc74f-e93c-4788-a30e-b208173d8845 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:05.794884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1058/2099] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:05 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:05.799084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebc74f-e93c-4788-a30e-b208173d8845 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:05.868412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebc74f-e93c-4788-a30e-b208173d8845 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:05.873491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32fa8d-24ad-4bf1-9c67-affbd47a24e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:05.874163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fa8d-24ad-4bf1-9c67-affbd47a24e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:05.874445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fa8d-24ad-4bf1-9c67-affbd47a24e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:05.874756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32fa8d-24ad-4bf1-9c67-affbd47a24e2 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:05.875487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32fa8d-24ad-4bf1-9c67-affbd47a24e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:05.878136 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32fa8d-24ad-4bf1-9c67-affbd47a24e2 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:05.944213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014feddfd96a4c769c3610b458da7edc'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.959970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014feddfd96a4c769c3610b458da7edc'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:05.992660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1059/2100] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:05 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:53:05.997561 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32fa8d-24ad-4bf1-9c67-affbd47a24e2 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:06.015332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:06.018391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32fa8d-24ad-4bf1-9c67-affbd47a24e2 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:06.032043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82470e-0eda-4fcd-9458-46a098b23cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:06.032771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82470e-0eda-4fcd-9458-46a098b23cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.038496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82470e-0eda-4fcd-9458-46a098b23cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.038496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82470e-0eda-4fcd-9458-46a098b23cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.038496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82470e-0eda-4fcd-9458-46a098b23cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:06.038496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82470e-0eda-4fcd-9458-46a098b23cd4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:06.059005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1060/2101] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:53:06.060261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82470e-0eda-4fcd-9458-46a098b23cd4 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:06.063300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014feddfd96a4c769c3610b458da7edc'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:06.064246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014feddfd96a4c769c3610b458da7edc'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:06.065968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b1d04dea-95f1-44bc-b8a4-4d3998046f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014feddfd96a4c769c3610b458da7edc'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:06.071008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82470e-0eda-4fcd-9458-46a098b23cd4 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:06.077849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53513882-7389-4f3a-a1b3-03813e0e7162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:06.078819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53513882-7389-4f3a-a1b3-03813e0e7162 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.078931 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53513882-7389-4f3a-a1b3-03813e0e7162 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.079807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53513882-7389-4f3a-a1b3-03813e0e7162 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.080314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53513882-7389-4f3a-a1b3-03813e0e7162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:06.082841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53513882-7389-4f3a-a1b3-03813e0e7162 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:06.103438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1042/2102] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:05 2022] DELETE /identity/v3/users/014feddfd96a4c769c3610b458da7edc => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:06.107510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1061/2103] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:06.108995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53513882-7389-4f3a-a1b3-03813e0e7162 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:06.109713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e31e4-9e80-4516-8312-bfb88adc1755 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.110344 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e31e4-9e80-4516-8312-bfb88adc1755 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.111097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e31e4-9e80-4516-8312-bfb88adc1755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.111206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-53513882-7389-4f3a-a1b3-03813e0e7162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:06.125124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53513882-7389-4f3a-a1b3-03813e0e7162 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:06.132747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9e9e31e4-9e80-4516-8312-bfb88adc1755 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:06.136253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9e9e31e4-9e80-4516-8312-bfb88adc1755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:06.199469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd118f-ed02-4c30-b189-e5c3ae5e1708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:06.200575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd118f-ed02-4c30-b189-e5c3ae5e1708 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.200885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd118f-ed02-4c30-b189-e5c3ae5e1708 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.201212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd118f-ed02-4c30-b189-e5c3ae5e1708 admin admin] PATH_INFO: `/v3/projects/6cd5b6aa6edd4bafa8aec3e9d28ae980/users/5e4214dbd10d491eb6afa50321edca88/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.221715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1043/2104] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:06.221715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e31e4-9e80-4516-8312-bfb88adc1755 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:06.221715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9e9e31e4-9e80-4516-8312-bfb88adc1755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:06.224659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd118f-ed02-4c30-b189-e5c3ae5e1708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd5b6aa6edd4bafa8aec3e9d28ae980, user_id=5e4214dbd10d491eb6afa50321edca88, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:06.229289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd118f-ed02-4c30-b189-e5c3ae5e1708 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:06.235085 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e31e4-9e80-4516-8312-bfb88adc1755 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:06.241359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:06.242595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.242873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.243146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] PATH_INFO: `/v3/projects/653fd7cdd0e240b181af741c9ecf38f8` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.244855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=653fd7cdd0e240b181af741c9ecf38f8)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:06.246802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:06.325916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1062/2105] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:06 2022] PUT /identity/v3/projects/6cd5b6aa6edd4bafa8aec3e9d28ae980/users/5e4214dbd10d491eb6afa50321edca88/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:06.331083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd118f-ed02-4c30-b189-e5c3ae5e1708 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:06.331083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b4dd118f-ed02-4c30-b189-e5c3ae5e1708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:06.390510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd118f-ed02-4c30-b189-e5c3ae5e1708 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:06.401981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653fd7cdd0e240b181af741c9ecf38f8', 'request_id': 'req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:06.409862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653fd7cdd0e240b181af741c9ecf38f8', 'request_id': 'req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:06.416845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653fd7cdd0e240b181af741c9ecf38f8', 'request_id': 'req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:06.442577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e572a-61fc-41a4-b1ca-3ac1bfd691da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:06.443235 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e572a-61fc-41a4-b1ca-3ac1bfd691da service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.443632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e572a-61fc-41a4-b1ca-3ac1bfd691da service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.443917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e572a-61fc-41a4-b1ca-3ac1bfd691da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.508109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e572a-61fc-41a4-b1ca-3ac1bfd691da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:06.513538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e572a-61fc-41a4-b1ca-3ac1bfd691da service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:06.518359 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] The token cache is being invalidate because project 653fd7cdd0e240b181af741c9ecf38f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:06.518840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:06.519501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54f0845a-1c5e-4199-9acb-4b53d9f61c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:06.521144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1044/2106] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:06 2022] DELETE /identity/v3/projects/653fd7cdd0e240b181af741c9ecf38f8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:06.522591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf853b8-946d-4eba-80cd-186e655477ef None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.522943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf853b8-946d-4eba-80cd-186e655477ef None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.523289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf853b8-946d-4eba-80cd-186e655477ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.528271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1063/2107] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:06.529676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c753f0-a1b6-4360-852d-acfab4e861f3 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.529978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c753f0-a1b6-4360-852d-acfab4e861f3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.530262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c753f0-a1b6-4360-852d-acfab4e861f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.553128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f8c753f0-a1b6-4360-852d-acfab4e861f3 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:06.554677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f8c753f0-a1b6-4360-852d-acfab4e861f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:06.565416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1064/2108] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:06.566026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-0bf853b8-946d-4eba-80cd-186e655477ef None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:06.570033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0bf853b8-946d-4eba-80cd-186e655477ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:06.574539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22a6e-0e9a-4f25-853b-0558f664664e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.575909 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22a6e-0e9a-4f25-853b-0558f664664e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.575909 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22a6e-0e9a-4f25-853b-0558f664664e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.584742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1045/2109] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:06.594980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf853b8-946d-4eba-80cd-186e655477ef None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:06.596459 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0bf853b8-946d-4eba-80cd-186e655477ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:06.598245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-29a22a6e-0e9a-4f25-853b-0558f664664e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:06.600646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-29a22a6e-0e9a-4f25-853b-0558f664664e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:06.609910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1065/2110] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:06.612938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf853b8-946d-4eba-80cd-186e655477ef None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:06.615982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a22a6e-0e9a-4f25-853b-0558f664664e None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:06.616246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59035db6-53a5-42e2-9ae9-c2a5073af245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:06.617161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59035db6-53a5-42e2-9ae9-c2a5073af245 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.617515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59035db6-53a5-42e2-9ae9-c2a5073af245 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.617946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59035db6-53a5-42e2-9ae9-c2a5073af245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.628594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a22a6e-0e9a-4f25-853b-0558f664664e None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:06.632014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59035db6-53a5-42e2-9ae9-c2a5073af245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:06.633501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa7cce-5ece-4373-9084-383b3c0fc85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:06.634081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59035db6-53a5-42e2-9ae9-c2a5073af245 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:06.634975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa7cce-5ece-4373-9084-383b3c0fc85a admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.635314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa7cce-5ece-4373-9084-383b3c0fc85a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.635711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa7cce-5ece-4373-9084-383b3c0fc85a admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.636745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa7cce-5ece-4373-9084-383b3c0fc85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:53:06.637112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa7cce-5ece-4373-9084-383b3c0fc85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:06.638901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa7cce-5ece-4373-9084-383b3c0fc85a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:06.645576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1046/2111] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:06.655394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1066/2112] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:53:06.657773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59035db6-53a5-42e2-9ae9-c2a5073af245 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:06.669095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59035db6-53a5-42e2-9ae9-c2a5073af245 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:06.674424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10534e5a-65eb-40d6-91c7-2669a2bfb975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:06.675098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10534e5a-65eb-40d6-91c7-2669a2bfb975 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.675408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10534e5a-65eb-40d6-91c7-2669a2bfb975 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.675685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10534e5a-65eb-40d6-91c7-2669a2bfb975 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.676380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10534e5a-65eb-40d6-91c7-2669a2bfb975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:06.678341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10534e5a-65eb-40d6-91c7-2669a2bfb975 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:06.817594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1047/2113] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:06 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:06.821367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa7cce-5ece-4373-9084-383b3c0fc85a admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:06.835745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa7cce-5ece-4373-9084-383b3c0fc85a admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:06.917345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192855b-23f0-4383-b54a-a326a9ffc8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:06.918138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192855b-23f0-4383-b54a-a326a9ffc8bb admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:06.918429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192855b-23f0-4383-b54a-a326a9ffc8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:06.918705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192855b-23f0-4383-b54a-a326a9ffc8bb admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:06.919468 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192855b-23f0-4383-b54a-a326a9ffc8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:06.921425 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192855b-23f0-4383-b54a-a326a9ffc8bb admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:07.006224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10534e5a-65eb-40d6-91c7-2669a2bfb975 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:07.013834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-10534e5a-65eb-40d6-91c7-2669a2bfb975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:07.013917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1067/2114] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:06 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:07.017649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192855b-23f0-4383-b54a-a326a9ffc8bb admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:07.030947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10534e5a-65eb-40d6-91c7-2669a2bfb975 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:07.043708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192855b-23f0-4383-b54a-a326a9ffc8bb admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:07.053514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:07.054566 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:07.060308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:07.060601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3fb7-a356-49fe-9afe-6fa1f0c7ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:07.060723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] PATH_INFO: `/v3/projects/0fe2d59b16f44ee6b1fb1053d68c9a6a` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:07.060799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3fb7-a356-49fe-9afe-6fa1f0c7ada5 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:07.060799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3fb7-a356-49fe-9afe-6fa1f0c7ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:07.060799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3fb7-a356-49fe-9afe-6fa1f0c7ada5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:07.060992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe2d59b16f44ee6b1fb1053d68c9a6a)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:07.061086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3fb7-a356-49fe-9afe-6fa1f0c7ada5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:07.061086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3fb7-a356-49fe-9afe-6fa1f0c7ada5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:07.063397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:07.077922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1068/2115] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:07.079446 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3fb7-a356-49fe-9afe-6fa1f0c7ada5 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:07.092330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3fb7-a356-49fe-9afe-6fa1f0c7ada5 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:07.098003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44465e-2a89-45da-80f6-9dadbdf1c500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:07.098705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44465e-2a89-45da-80f6-9dadbdf1c500 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:07.098998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44465e-2a89-45da-80f6-9dadbdf1c500 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:07.099275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44465e-2a89-45da-80f6-9dadbdf1c500 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:07.100037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44465e-2a89-45da-80f6-9dadbdf1c500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:07.101681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44465e-2a89-45da-80f6-9dadbdf1c500 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:07.114244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1069/2116] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:07.119738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44465e-2a89-45da-80f6-9dadbdf1c500 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:07.133265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44465e-2a89-45da-80f6-9dadbdf1c500 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:07.138429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5d4e3-f1af-4961-9efa-f4e436060365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:07.139403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5d4e3-f1af-4961-9efa-f4e436060365 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:07.139687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5d4e3-f1af-4961-9efa-f4e436060365 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:07.139990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5d4e3-f1af-4961-9efa-f4e436060365 admin admin] PATH_INFO: `/v3/projects/b133179dade8437da22cd02cde23dc95/users/5b76b9c7171048fd95aef873723e0b19/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:07.156796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5d4e3-f1af-4961-9efa-f4e436060365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b133179dade8437da22cd02cde23dc95, user_id=5b76b9c7171048fd95aef873723e0b19, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:07.159597 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5d4e3-f1af-4961-9efa-f4e436060365 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:07.315182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1070/2117] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:07 2022] PUT /identity/v3/projects/b133179dade8437da22cd02cde23dc95/users/5b76b9c7171048fd95aef873723e0b19/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:07.325173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe2d59b16f44ee6b1fb1053d68c9a6a', 'request_id': 'req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:07.326424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55853-94b1-439a-b8ea-a435fc52ebd0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:07.326721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55853-94b1-439a-b8ea-a435fc52ebd0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:07.327014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55853-94b1-439a-b8ea-a435fc52ebd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:07.333223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe2d59b16f44ee6b1fb1053d68c9a6a', 'request_id': 'req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:07.347514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe2d59b16f44ee6b1fb1053d68c9a6a', 'request_id': 'req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:07.363403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-16a55853-94b1-439a-b8ea-a435fc52ebd0 None None] MFA Rules not processed for user `5b76b9c7171048fd95aef873723e0b19`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:07.364662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-16a55853-94b1-439a-b8ea-a435fc52ebd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:07.455803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1071/2118] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:07.467514 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55853-94b1-439a-b8ea-a435fc52ebd0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:07.469020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-16a55853-94b1-439a-b8ea-a435fc52ebd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:07.482592 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] The token cache is being invalidate because project 0fe2d59b16f44ee6b1fb1053d68c9a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:07.483057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:07.483907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:07.485754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1048/2119] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:07 2022] DELETE /identity/v3/projects/0fe2d59b16f44ee6b1fb1053d68c9a6a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:07.489823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:07.491249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:07.549517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55853-94b1-439a-b8ea-a435fc52ebd0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:07.553834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6369-d42f-476f-bfac-47b3fcfe67d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:07.554492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6369-d42f-476f-bfac-47b3fcfe67d2 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:07.554774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6369-d42f-476f-bfac-47b3fcfe67d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:07.555054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6369-d42f-476f-bfac-47b3fcfe67d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:07.561633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ab8e6369-d42f-476f-bfac-47b3fcfe67d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:07.573758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e6369-d42f-476f-bfac-47b3fcfe67d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:07.575319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e6369-d42f-476f-bfac-47b3fcfe67d2 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:07.581793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945a9cf-71ca-4d02-b0c3-078cc5923dc4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:07.587143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1072/2120] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:53:07.588250 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:07.591312 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:07.592229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:07.592688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:07.592894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] PATH_INFO: `/v3/users/c0ea6cbb601b4c80897c01299b1b52f7` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:07.597332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ea6cbb601b4c80897c01299b1b52f7)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:07.605470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:07.780310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ea6cbb601b4c80897c01299b1b52f7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:07.788004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ea6cbb601b4c80897c01299b1b52f7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:07.849351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:07.874196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ea6cbb601b4c80897c01299b1b52f7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:07.874738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ea6cbb601b4c80897c01299b1b52f7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:07.875380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-575d6bfb-8e18-44ae-b909-232e864d799d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ea6cbb601b4c80897c01299b1b52f7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:07.900636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1049/2121] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:07 2022] DELETE /identity/v3/users/c0ea6cbb601b4c80897c01299b1b52f7 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:08.501946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6369-d42f-476f-bfac-47b3fcfe67d2 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:08.514200 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6369-d42f-476f-bfac-47b3fcfe67d2 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:08.598631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:08.599548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:08.599914 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:08.600799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] PATH_INFO: `/v3/projects/42b7ccfd96ca49ca9dc266fc153be869` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:08.604239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b7ccfd96ca49ca9dc266fc153be869)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:08.606321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:08.741099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b7ccfd96ca49ca9dc266fc153be869', 'request_id': 'req-77d033e6-7822-41e9-b1f2-cab68986a831'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:08.748547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b7ccfd96ca49ca9dc266fc153be869', 'request_id': 'req-77d033e6-7822-41e9-b1f2-cab68986a831'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:08.755477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b7ccfd96ca49ca9dc266fc153be869', 'request_id': 'req-77d033e6-7822-41e9-b1f2-cab68986a831'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:08.838551 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] The token cache is being invalidate because project 42b7ccfd96ca49ca9dc266fc153be869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:08.839231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:08.840014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77d033e6-7822-41e9-b1f2-cab68986a831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:08.841617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1073/2122] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:08 2022] DELETE /identity/v3/projects/42b7ccfd96ca49ca9dc266fc153be869 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:08.849841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d018b0e-8c72-40c3-87a1-7d343e634d9b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:08.852159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d018b0e-8c72-40c3-87a1-7d343e634d9b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:08.853382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d018b0e-8c72-40c3-87a1-7d343e634d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:08.876455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2d018b0e-8c72-40c3-87a1-7d343e634d9b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:08.887116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2d018b0e-8c72-40c3-87a1-7d343e634d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:08.992073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1050/2123] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:09.001260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666addb-85b3-4f79-b56c-e7fb2d25f2a3 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:09.001789 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666addb-85b3-4f79-b56c-e7fb2d25f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:09.001886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666addb-85b3-4f79-b56c-e7fb2d25f2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:09.028281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3666addb-85b3-4f79-b56c-e7fb2d25f2a3 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:09.028281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3666addb-85b3-4f79-b56c-e7fb2d25f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:09.039756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1074/2124] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:09.045017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d018b0e-8c72-40c3-87a1-7d343e634d9b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:09.058224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d018b0e-8c72-40c3-87a1-7d343e634d9b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:09.065055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8da6ac-123c-4cc9-9266-5069ad998091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:09.065942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8da6ac-123c-4cc9-9266-5069ad998091 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:09.066290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8da6ac-123c-4cc9-9266-5069ad998091 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:09.066647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8da6ac-123c-4cc9-9266-5069ad998091 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:09.067875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8da6ac-123c-4cc9-9266-5069ad998091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:53:09.067875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8da6ac-123c-4cc9-9266-5069ad998091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:09.069472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8da6ac-123c-4cc9-9266-5069ad998091 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:09.083630 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1051/2125] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:53:09.092940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666addb-85b3-4f79-b56c-e7fb2d25f2a3 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:09.100858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666addb-85b3-4f79-b56c-e7fb2d25f2a3 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:09.109991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401303cc-54af-4e63-b4ac-da8f96a11cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:09.111508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401303cc-54af-4e63-b4ac-da8f96a11cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:09.111508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401303cc-54af-4e63-b4ac-da8f96a11cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:09.111508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401303cc-54af-4e63-b4ac-da8f96a11cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:09.112012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401303cc-54af-4e63-b4ac-da8f96a11cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:09.113979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401303cc-54af-4e63-b4ac-da8f96a11cd0 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:09.220836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1075/2126] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:09 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:53:09.222333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8da6ac-123c-4cc9-9266-5069ad998091 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:09.240669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8da6ac-123c-4cc9-9266-5069ad998091 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:09.335709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:09.350821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebbf11-c9a9-4472-8f55-bdc55daddf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:09.351644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebbf11-c9a9-4472-8f55-bdc55daddf67 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:09.355758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebbf11-c9a9-4472-8f55-bdc55daddf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:09.355758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebbf11-c9a9-4472-8f55-bdc55daddf67 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:09.355758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebbf11-c9a9-4472-8f55-bdc55daddf67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:09.357610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebbf11-c9a9-4472-8f55-bdc55daddf67 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:09.491605 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1052/2127] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:09 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:09.496008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401303cc-54af-4e63-b4ac-da8f96a11cd0 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:09.506562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401303cc-54af-4e63-b4ac-da8f96a11cd0 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:09.516318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9afa6a-f9c7-4d04-a820-55814e496f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:09.517032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9afa6a-f9c7-4d04-a820-55814e496f78 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:09.517314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9afa6a-f9c7-4d04-a820-55814e496f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:09.517590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9afa6a-f9c7-4d04-a820-55814e496f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:09.527932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9afa6a-f9c7-4d04-a820-55814e496f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:09.527932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9afa6a-f9c7-4d04-a820-55814e496f78 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:09.537647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1076/2128] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:09.542686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebbf11-c9a9-4472-8f55-bdc55daddf67 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:09.560942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebbf11-c9a9-4472-8f55-bdc55daddf67 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:09.568189 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa40f3e-7336-4a39-83c4-853f53e327cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:09.569949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40f3e-7336-4a39-83c4-853f53e327cc admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:09.569949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40f3e-7336-4a39-83c4-853f53e327cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:09.570130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40f3e-7336-4a39-83c4-853f53e327cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:09.570833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa40f3e-7336-4a39-83c4-853f53e327cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:09.573090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa40f3e-7336-4a39-83c4-853f53e327cc admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:09.584754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1053/2129] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:09.589885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9afa6a-f9c7-4d04-a820-55814e496f78 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:09.601496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9afa6a-f9c7-4d04-a820-55814e496f78 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:09.616044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c3aff-3293-424f-9035-b412edcced5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:09.617183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c3aff-3293-424f-9035-b412edcced5d admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:09.617637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c3aff-3293-424f-9035-b412edcced5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:09.617928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c3aff-3293-424f-9035-b412edcced5d admin admin] PATH_INFO: `/v3/projects/d307b17ff8f749b7b1790f73f91b5170/users/729d15fea6c54cf291572a7fbe8cdc15/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:09.636927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c3aff-3293-424f-9035-b412edcced5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d307b17ff8f749b7b1790f73f91b5170, user_id=729d15fea6c54cf291572a7fbe8cdc15, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:09.639583 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c3aff-3293-424f-9035-b412edcced5d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:09.724698 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:09.735380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1077/2130] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:09 2022] PUT /identity/v3/projects/d307b17ff8f749b7b1790f73f91b5170/users/729d15fea6c54cf291572a7fbe8cdc15/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:09.755994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87f58-0e2f-4aeb-a2a3-d75b7de505a1 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:09.756292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87f58-0e2f-4aeb-a2a3-d75b7de505a1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:09.756576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87f58-0e2f-4aeb-a2a3-d75b7de505a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:09.846011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d4d87f58-0e2f-4aeb-a2a3-d75b7de505a1 None None] MFA Rules not processed for user `729d15fea6c54cf291572a7fbe8cdc15`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:09.847257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d4d87f58-0e2f-4aeb-a2a3-d75b7de505a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:09.959278 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1054/2131] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:09.973165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c3aff-3293-424f-9035-b412edcced5d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:09.979156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3a2c3aff-3293-424f-9035-b412edcced5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:10.051984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c3aff-3293-424f-9035-b412edcced5d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:10.057508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e93ef0-c77c-4ff7-a2bb-dcdcadca0566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:10.059321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e93ef0-c77c-4ff7-a2bb-dcdcadca0566 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:10.059321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e93ef0-c77c-4ff7-a2bb-dcdcadca0566 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:10.059321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e93ef0-c77c-4ff7-a2bb-dcdcadca0566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:10.068949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e93ef0-c77c-4ff7-a2bb-dcdcadca0566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:10.070495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e93ef0-c77c-4ff7-a2bb-dcdcadca0566 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:10.081629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1078/2132] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:10.983110 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87f58-0e2f-4aeb-a2a3-d75b7de505a1 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:10.984849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d4d87f58-0e2f-4aeb-a2a3-d75b7de505a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:11.062365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87f58-0e2f-4aeb-a2a3-d75b7de505a1 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:11.068379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:11.069283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:11.069587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:11.069860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] PATH_INFO: `/v3/users/5b76b9c7171048fd95aef873723e0b19` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:11.076156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b76b9c7171048fd95aef873723e0b19)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:11.078905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:11.388206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b76b9c7171048fd95aef873723e0b19'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:11.398731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:11.414172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b76b9c7171048fd95aef873723e0b19'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:11.518628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b76b9c7171048fd95aef873723e0b19'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:11.519674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b76b9c7171048fd95aef873723e0b19'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:11.520611 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b76b9c7171048fd95aef873723e0b19'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:11.544940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1055/2133] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:10 2022] DELETE /identity/v3/users/5b76b9c7171048fd95aef873723e0b19 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:11.549599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9afc9-bf74-49c1-9faa-735b10702a73 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:11.550421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9afc9-bf74-49c1-9faa-735b10702a73 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:11.550856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9afc9-bf74-49c1-9faa-735b10702a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:11.571263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-20e9afc9-bf74-49c1-9faa-735b10702a73 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:11.572992 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-20e9afc9-bf74-49c1-9faa-735b10702a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:11.639701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1079/2134] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:11.652058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:11.653768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:11.730909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6a3f6-d4b0-449b-b069-df4bd984e64f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:11.739878 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc7666-2e08-4687-9b81-5f3620c7a4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:11.744102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc7666-2e08-4687-9b81-5f3620c7a4ac service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:11.744740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc7666-2e08-4687-9b81-5f3620c7a4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:11.745801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc7666-2e08-4687-9b81-5f3620c7a4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:11.767690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc7666-2e08-4687-9b81-5f3620c7a4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:11.769255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc7666-2e08-4687-9b81-5f3620c7a4ac service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:11.788590 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1056/2135] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:12.443929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:12.622396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9afc9-bf74-49c1-9faa-735b10702a73 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:12.623919 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-20e9afc9-bf74-49c1-9faa-735b10702a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:12.638519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9afc9-bf74-49c1-9faa-735b10702a73 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:12.643987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:12.645116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:12.646195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:12.646642 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] PATH_INFO: `/v3/projects/b133179dade8437da22cd02cde23dc95` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:12.648455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b133179dade8437da22cd02cde23dc95)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:12.651695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:12.800678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b133179dade8437da22cd02cde23dc95', 'request_id': 'req-fa7f745d-d2c8-4921-acb6-9cc0562af546'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:12.815115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b133179dade8437da22cd02cde23dc95', 'request_id': 'req-fa7f745d-d2c8-4921-acb6-9cc0562af546'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:12.823241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b133179dade8437da22cd02cde23dc95', 'request_id': 'req-fa7f745d-d2c8-4921-acb6-9cc0562af546'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:12.956965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] The token cache is being invalidate because project b133179dade8437da22cd02cde23dc95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:12.956965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:12.956965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fa7f745d-d2c8-4921-acb6-9cc0562af546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:12.959398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1080/2136] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:12 2022] DELETE /identity/v3/projects/b133179dade8437da22cd02cde23dc95 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:12.965146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fa3f1-787d-45d9-b746-bb0aaea6bd23 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:12.966097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fa3f1-787d-45d9-b746-bb0aaea6bd23 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:12.969103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fa3f1-787d-45d9-b746-bb0aaea6bd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.001174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-781fa3f1-787d-45d9-b746-bb0aaea6bd23 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:13.002610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-781fa3f1-787d-45d9-b746-bb0aaea6bd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:13.127900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1057/2137] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:13.133828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c29311-1195-4e95-8402-35a96b624740 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:13.135037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c29311-1195-4e95-8402-35a96b624740 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:13.135530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c29311-1195-4e95-8402-35a96b624740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.161920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-00c29311-1195-4e95-8402-35a96b624740 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:13.163417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-00c29311-1195-4e95-8402-35a96b624740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:13.178677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1081/2138] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:13.183650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fa3f1-787d-45d9-b746-bb0aaea6bd23 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:13.195264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fa3f1-787d-45d9-b746-bb0aaea6bd23 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:13.200945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fced2ac-6557-46a0-87c5-3966f0e2b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:13.201847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fced2ac-6557-46a0-87c5-3966f0e2b285 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:13.202406 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fced2ac-6557-46a0-87c5-3966f0e2b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:13.202586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fced2ac-6557-46a0-87c5-3966f0e2b285 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.203452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fced2ac-6557-46a0-87c5-3966f0e2b285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:53:13.203770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fced2ac-6557-46a0-87c5-3966f0e2b285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:13.205529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fced2ac-6557-46a0-87c5-3966f0e2b285 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:13.221325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1058/2139] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:53:13.230599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c29311-1195-4e95-8402-35a96b624740 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:13.240791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c29311-1195-4e95-8402-35a96b624740 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:13.246921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d937d-b8af-418f-a848-3361438c844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:13.249445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d937d-b8af-418f-a848-3361438c844c admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:13.249445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d937d-b8af-418f-a848-3361438c844c admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:13.249445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d937d-b8af-418f-a848-3361438c844c admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.249445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d937d-b8af-418f-a848-3361438c844c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:13.251391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d937d-b8af-418f-a848-3361438c844c admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:13.352579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1082/2140] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:13 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:13.357967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fced2ac-6557-46a0-87c5-3966f0e2b285 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:13.369180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fced2ac-6557-46a0-87c5-3966f0e2b285 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:13.458020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728fc3d-4e2c-4c18-b0fe-7b48bb2b1324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:13.458563 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728fc3d-4e2c-4c18-b0fe-7b48bb2b1324 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:13.458980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728fc3d-4e2c-4c18-b0fe-7b48bb2b1324 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:13.459468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728fc3d-4e2c-4c18-b0fe-7b48bb2b1324 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.460491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728fc3d-4e2c-4c18-b0fe-7b48bb2b1324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:13.463431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728fc3d-4e2c-4c18-b0fe-7b48bb2b1324 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:13.616371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1059/2141] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:13 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:13.621098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d937d-b8af-418f-a848-3361438c844c admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:13.636416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d937d-b8af-418f-a848-3361438c844c admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:13.651229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b3a44-92a1-4356-9def-85fa8a1222a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:13.652146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b3a44-92a1-4356-9def-85fa8a1222a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:13.661672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b3a44-92a1-4356-9def-85fa8a1222a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:13.661672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b3a44-92a1-4356-9def-85fa8a1222a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.661672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b3a44-92a1-4356-9def-85fa8a1222a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:13.661672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b3a44-92a1-4356-9def-85fa8a1222a5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:13.672556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728fc3d-4e2c-4c18-b0fe-7b48bb2b1324 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:13.673861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1083/2142] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:13.687758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728fc3d-4e2c-4c18-b0fe-7b48bb2b1324 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:13.700785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c9e68-002b-4579-8a4f-fc093d3ea1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:13.700785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c9e68-002b-4579-8a4f-fc093d3ea1cb admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:13.700785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c9e68-002b-4579-8a4f-fc093d3ea1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:13.700785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c9e68-002b-4579-8a4f-fc093d3ea1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.701172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c9e68-002b-4579-8a4f-fc093d3ea1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:13.707296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c9e68-002b-4579-8a4f-fc093d3ea1cb admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:13.731713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b3a44-92a1-4356-9def-85fa8a1222a5 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:13.733830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1060/2143] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:13.749671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b3a44-92a1-4356-9def-85fa8a1222a5 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:13.756322 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548eeb4-0062-49be-be34-2c83da8de121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:13.757314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548eeb4-0062-49be-be34-2c83da8de121 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:13.757601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548eeb4-0062-49be-be34-2c83da8de121 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:13.757881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548eeb4-0062-49be-be34-2c83da8de121 admin admin] PATH_INFO: `/v3/projects/7e69cf14c3c8482fbf95620efe1bee1d/users/fec25ac241c94d4dbebb361c55f10f75/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.795474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21195b8-16e4-4dd2-b863-98d6f92a5498 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:13.796143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21195b8-16e4-4dd2-b863-98d6f92a5498 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:13.796645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21195b8-16e4-4dd2-b863-98d6f92a5498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.804802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548eeb4-0062-49be-be34-2c83da8de121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e69cf14c3c8482fbf95620efe1bee1d, user_id=fec25ac241c94d4dbebb361c55f10f75, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:13.814299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548eeb4-0062-49be-be34-2c83da8de121 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:13.821476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:13.842302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b21195b8-16e4-4dd2-b863-98d6f92a5498 None None] MFA Rules not processed for user `5e4214dbd10d491eb6afa50321edca88`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:13.844799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b21195b8-16e4-4dd2-b863-98d6f92a5498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:13.919397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1061/2144] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:13.926157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1084/2145] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:13 2022] PUT /identity/v3/projects/7e69cf14c3c8482fbf95620efe1bee1d/users/fec25ac241c94d4dbebb361c55f10f75/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:13.931158 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3539a-0898-4c11-9e41-e7a7d0cab865 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:13.931503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3539a-0898-4c11-9e41-e7a7d0cab865 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:13.931875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3539a-0898-4c11-9e41-e7a7d0cab865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.933736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d0537-5b35-4b32-8173-a661a03143cf None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:13.934139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d0537-5b35-4b32-8173-a661a03143cf None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:13.934439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d0537-5b35-4b32-8173-a661a03143cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:13.955443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-8cf3539a-0898-4c11-9e41-e7a7d0cab865 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:13.956941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-8cf3539a-0898-4c11-9e41-e7a7d0cab865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:13.957194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-122d0537-5b35-4b32-8173-a661a03143cf None None] MFA Rules not processed for user `5e4214dbd10d491eb6afa50321edca88`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:13.958367 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-122d0537-5b35-4b32-8173-a661a03143cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:14.021266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1062/2146] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:14.032491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1085/2147] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:14.033129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d0537-5b35-4b32-8173-a661a03143cf None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:14.034534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-122d0537-5b35-4b32-8173-a661a03143cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:14.042688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3539a-0898-4c11-9e41-e7a7d0cab865 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:14.044156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-8cf3539a-0898-4c11-9e41-e7a7d0cab865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:14.109824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3539a-0898-4c11-9e41-e7a7d0cab865 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:14.113753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd455a-5b1e-4c68-9974-1611cec59495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:14.114470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd455a-5b1e-4c68-9974-1611cec59495 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:14.114789 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd455a-5b1e-4c68-9974-1611cec59495 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:14.115165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd455a-5b1e-4c68-9974-1611cec59495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:14.124541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d0537-5b35-4b32-8173-a661a03143cf None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:14.126133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd455a-5b1e-4c68-9974-1611cec59495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:14.128893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd455a-5b1e-4c68-9974-1611cec59495 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:14.131950 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b452069-f377-4c49-802d-da991695ebef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:14.132622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b452069-f377-4c49-802d-da991695ebef service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:14.133012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b452069-f377-4c49-802d-da991695ebef service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:14.133484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b452069-f377-4c49-802d-da991695ebef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:14.142177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1086/2148] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:14.146255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b452069-f377-4c49-802d-da991695ebef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:14.147979 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b452069-f377-4c49-802d-da991695ebef service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:14.158660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1063/2149] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:14.450198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:15.144561 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f605782-4185-4971-81d6-c2bbfc940740 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:15.145192 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f605782-4185-4971-81d6-c2bbfc940740 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:15.145192 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f605782-4185-4971-81d6-c2bbfc940740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:15.166575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-9f605782-4185-4971-81d6-c2bbfc940740 None None] MFA Rules not processed for user `5e4214dbd10d491eb6afa50321edca88`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:15.169055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9f605782-4185-4971-81d6-c2bbfc940740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:15.186805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1087/2150] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:15.964902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:16.232216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:19.382060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:19.535210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:21.319616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:22.164275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:22.394463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2a12-3c2f-4744-aade-22e596a9a3c8 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:22.395020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2a12-3c2f-4744-aade-22e596a9a3c8 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:22.395232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2a12-3c2f-4744-aade-22e596a9a3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:22.402846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:22.426885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8b9f2a12-3c2f-4744-aade-22e596a9a3c8 None None] MFA Rules not processed for user `fec25ac241c94d4dbebb361c55f10f75`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:22.436206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8b9f2a12-3c2f-4744-aade-22e596a9a3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:22.505047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1064/2151] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:22.531262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f605782-4185-4971-81d6-c2bbfc940740 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:22.543379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f605782-4185-4971-81d6-c2bbfc940740 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:22.547976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885197a-939f-47ad-ab99-2923d8b867fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:22.548630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885197a-939f-47ad-ab99-2923d8b867fe admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:22.548946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885197a-939f-47ad-ab99-2923d8b867fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:22.549224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885197a-939f-47ad-ab99-2923d8b867fe admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:22.549911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885197a-939f-47ad-ab99-2923d8b867fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:22.551857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885197a-939f-47ad-ab99-2923d8b867fe admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:22.769806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1088/2152] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:22 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:22.771308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f2a12-3c2f-4744-aade-22e596a9a3c8 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:22.786648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f2a12-3c2f-4744-aade-22e596a9a3c8 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:22.866508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bd958-5b8c-4173-88ae-47d14bffa9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:22.866848 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd958-5b8c-4173-88ae-47d14bffa9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:22.867215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd958-5b8c-4173-88ae-47d14bffa9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:22.867591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd958-5b8c-4173-88ae-47d14bffa9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:22.868933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bd958-5b8c-4173-88ae-47d14bffa9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:22.871577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bd958-5b8c-4173-88ae-47d14bffa9f8 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:23.012755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1065/2153] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:22 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:53:23.016492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885197a-939f-47ad-ab99-2923d8b867fe admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:23.057447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885197a-939f-47ad-ab99-2923d8b867fe admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:23.088303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19cccf-4904-408f-99e4-47a58fffbef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:23.089987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19cccf-4904-408f-99e4-47a58fffbef7 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:23.090434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19cccf-4904-408f-99e4-47a58fffbef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:23.090865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19cccf-4904-408f-99e4-47a58fffbef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:23.092303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19cccf-4904-408f-99e4-47a58fffbef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:23.094324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19cccf-4904-408f-99e4-47a58fffbef7 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:23.122993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1089/2154] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:23.127472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bd958-5b8c-4173-88ae-47d14bffa9f8 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:23.146996 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19cccf-4904-408f-99e4-47a58fffbef7 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:23.151550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2d19cccf-4904-408f-99e4-47a58fffbef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:23.152391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bd958-5b8c-4173-88ae-47d14bffa9f8 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:23.169324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db79897-abe3-4774-89cd-22760983366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:23.170597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db79897-abe3-4774-89cd-22760983366d admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:23.171492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db79897-abe3-4774-89cd-22760983366d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:23.171941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db79897-abe3-4774-89cd-22760983366d admin admin] PATH_INFO: `/v3/projects/cdb8e007017448af89eb5c73a839740d/users/fe2ef5a0f3b247c28929b28e03dace2d/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:23.194848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19cccf-4904-408f-99e4-47a58fffbef7 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:23.208851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:23.210557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:23.210887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:23.213217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] PATH_INFO: `/v3/users/729d15fea6c54cf291572a7fbe8cdc15` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:23.215339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=729d15fea6c54cf291572a7fbe8cdc15)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:23.218649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:23.219855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db79897-abe3-4774-89cd-22760983366d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb8e007017448af89eb5c73a839740d, user_id=fe2ef5a0f3b247c28929b28e03dace2d, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:23.233813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db79897-abe3-4774-89cd-22760983366d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:23.359173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1066/2155] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:23 2022] PUT /identity/v3/projects/cdb8e007017448af89eb5c73a839740d/users/fe2ef5a0f3b247c28929b28e03dace2d/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:23.364651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db79897-abe3-4774-89cd-22760983366d admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:23.442084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db79897-abe3-4774-89cd-22760983366d admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:23.451937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed707096-0cfb-4916-ac52-c2048d3e0a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:23.453188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed707096-0cfb-4916-ac52-c2048d3e0a91 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:23.453649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed707096-0cfb-4916-ac52-c2048d3e0a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:23.454672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed707096-0cfb-4916-ac52-c2048d3e0a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:23.455711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed707096-0cfb-4916-ac52-c2048d3e0a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:23.457781 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed707096-0cfb-4916-ac52-c2048d3e0a91 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:23.498173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1067/2156] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:53:23.503040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed707096-0cfb-4916-ac52-c2048d3e0a91 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:23.521241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed707096-0cfb-4916-ac52-c2048d3e0a91 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:23.530706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19559fb0-0c28-4b1d-b33c-d2f1842ddd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:23.532462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19559fb0-0c28-4b1d-b33c-d2f1842ddd1a admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:23.532838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19559fb0-0c28-4b1d-b33c-d2f1842ddd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:23.533248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19559fb0-0c28-4b1d-b33c-d2f1842ddd1a admin admin] PATH_INFO: `/v3/projects/cdb8e007017448af89eb5c73a839740d/users/fe2ef5a0f3b247c28929b28e03dace2d/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:23.536674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19559fb0-0c28-4b1d-b33c-d2f1842ddd1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb8e007017448af89eb5c73a839740d, user_id=fe2ef5a0f3b247c28929b28e03dace2d, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:23.548557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19559fb0-0c28-4b1d-b33c-d2f1842ddd1a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:23.550955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '729d15fea6c54cf291572a7fbe8cdc15'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:23.561065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1068/2157] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:23 2022] PUT /identity/v3/projects/cdb8e007017448af89eb5c73a839740d/users/fe2ef5a0f3b247c28929b28e03dace2d/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:23.591676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '729d15fea6c54cf291572a7fbe8cdc15'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:23.701449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '729d15fea6c54cf291572a7fbe8cdc15'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:23.712680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '729d15fea6c54cf291572a7fbe8cdc15'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:23.713458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '729d15fea6c54cf291572a7fbe8cdc15'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:23.728003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1090/2158] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:23 2022] DELETE /identity/v3/users/729d15fea6c54cf291572a7fbe8cdc15 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:23.732954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57a26a-7549-4f71-87b9-cab80c4bb583 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:23.733342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57a26a-7549-4f71-87b9-cab80c4bb583 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:23.733514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57a26a-7549-4f71-87b9-cab80c4bb583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:23.767816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9f57a26a-7549-4f71-87b9-cab80c4bb583 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:23.769388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9f57a26a-7549-4f71-87b9-cab80c4bb583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:23.953304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1069/2159] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:23.976256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:23.977936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:23.985912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57a26a-7549-4f71-87b9-cab80c4bb583 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:23.987517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9f57a26a-7549-4f71-87b9-cab80c4bb583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:24.010859 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57a26a-7549-4f71-87b9-cab80c4bb583 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:24.022850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:24.023883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:24.024198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:24.025285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] PATH_INFO: `/v3/users/318b95578d7748bfa2b715bd3a4aa8e0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:24.028957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=318b95578d7748bfa2b715bd3a4aa8e0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:24.034447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:24.132114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58c69c-4a66-4c4f-996f-b943c7c95a92 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:24.147181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566216fe-43e5-4248-bbf8-ad7919e99e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:24.150066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566216fe-43e5-4248-bbf8-ad7919e99e72 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:24.150066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566216fe-43e5-4248-bbf8-ad7919e99e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:24.150066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566216fe-43e5-4248-bbf8-ad7919e99e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:24.174918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566216fe-43e5-4248-bbf8-ad7919e99e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:24.177895 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566216fe-43e5-4248-bbf8-ad7919e99e72 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:24.210497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1091/2160] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:24.320208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318b95578d7748bfa2b715bd3a4aa8e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:24.331774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318b95578d7748bfa2b715bd3a4aa8e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:24.427826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318b95578d7748bfa2b715bd3a4aa8e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:24.429512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318b95578d7748bfa2b715bd3a4aa8e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:24.441847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318b95578d7748bfa2b715bd3a4aa8e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:24.519045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1070/2161] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:23 2022] DELETE /identity/v3/users/318b95578d7748bfa2b715bd3a4aa8e0 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:24.525363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913312-604a-406a-adc3-f46d37963268 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:24.526769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913312-604a-406a-adc3-f46d37963268 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:24.528447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913312-604a-406a-adc3-f46d37963268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:24.570099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-37913312-604a-406a-adc3-f46d37963268 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:24.574429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-37913312-604a-406a-adc3-f46d37963268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:24.730335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:24.756949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1092/2162] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:24.824309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:24.825313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:24.872395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:24.996207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11d318-e660-4bd1-983e-9c5946d5e5de admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:25.004328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea83d-62f2-44b7-a29c-d6a73697cf9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:25.005297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea83d-62f2-44b7-a29c-d6a73697cf9e service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:25.005748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea83d-62f2-44b7-a29c-d6a73697cf9e service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:25.006187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea83d-62f2-44b7-a29c-d6a73697cf9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:25.020054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea83d-62f2-44b7-a29c-d6a73697cf9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:25.024546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea83d-62f2-44b7-a29c-d6a73697cf9e service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:25.041110 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1071/2163] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:25.342674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913312-604a-406a-adc3-f46d37963268 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:25.349679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-37913312-604a-406a-adc3-f46d37963268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:25.385736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913312-604a-406a-adc3-f46d37963268 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:25.395811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:25.397903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:25.398632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:25.400587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] PATH_INFO: `/v3/projects/d307b17ff8f749b7b1790f73f91b5170` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:25.403092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d307b17ff8f749b7b1790f73f91b5170)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:25.409248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:25.627281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd307b17ff8f749b7b1790f73f91b5170', 'request_id': 'req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:25.634639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd307b17ff8f749b7b1790f73f91b5170', 'request_id': 'req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:25.642753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd307b17ff8f749b7b1790f73f91b5170', 'request_id': 'req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:25.779248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] The token cache is being invalidate because project d307b17ff8f749b7b1790f73f91b5170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:25.780244 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:25.798936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7842fffd-9d05-4c51-b8f1-22df0b1f1e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:25.801173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1093/2164] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:25 2022] DELETE /identity/v3/projects/d307b17ff8f749b7b1790f73f91b5170 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:25.806586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776d4a3-02ba-4411-ae6c-02c6aef73aa2 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:25.807097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776d4a3-02ba-4411-ae6c-02c6aef73aa2 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:25.807255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776d4a3-02ba-4411-ae6c-02c6aef73aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:25.844473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c776d4a3-02ba-4411-ae6c-02c6aef73aa2 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:25.846397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c776d4a3-02ba-4411-ae6c-02c6aef73aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:25.936391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1072/2165] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:25.944666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9d11-0049-4278-8f85-3a06622b4b53 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:25.944951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9d11-0049-4278-8f85-3a06622b4b53 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:25.956088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee9d11-0049-4278-8f85-3a06622b4b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:25.974672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776d4a3-02ba-4411-ae6c-02c6aef73aa2 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:25.976749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c776d4a3-02ba-4411-ae6c-02c6aef73aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:25.995265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-ccee9d11-0049-4278-8f85-3a06622b4b53 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:25.999434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ccee9d11-0049-4278-8f85-3a06622b4b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:26.001558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776d4a3-02ba-4411-ae6c-02c6aef73aa2 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:26.008304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:26.017196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1094/2166] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:26.021658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee9d11-0049-4278-8f85-3a06622b4b53 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:26.036435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.036435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.036435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] PATH_INFO: `/v3/projects/aca4ac9e773b490dbe46f1725cb5e340` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:26.036435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca4ac9e773b490dbe46f1725cb5e340)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:26.038834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:26.043265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee9d11-0049-4278-8f85-3a06622b4b53 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:26.050297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9fddd-3184-4780-b3b7-cf252690ab3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:26.052054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9fddd-3184-4780-b3b7-cf252690ab3c admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.052614 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9fddd-3184-4780-b3b7-cf252690ab3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.053221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9fddd-3184-4780-b3b7-cf252690ab3c admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:26.054369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9fddd-3184-4780-b3b7-cf252690ab3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:53:26.054835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9fddd-3184-4780-b3b7-cf252690ab3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:26.057951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9fddd-3184-4780-b3b7-cf252690ab3c admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:26.078474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1095/2167] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:53:26.079832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9fddd-3184-4780-b3b7-cf252690ab3c admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:26.092221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9fddd-3184-4780-b3b7-cf252690ab3c admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:26.098192 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec61d9-05e7-439c-a307-010dcc1ed2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:26.099034 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec61d9-05e7-439c-a307-010dcc1ed2cd admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.099482 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec61d9-05e7-439c-a307-010dcc1ed2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.100366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec61d9-05e7-439c-a307-010dcc1ed2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:26.100714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec61d9-05e7-439c-a307-010dcc1ed2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:26.103759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec61d9-05e7-439c-a307-010dcc1ed2cd admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:26.189539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca4ac9e773b490dbe46f1725cb5e340', 'request_id': 'req-05f39bfb-29f4-4ff3-b383-3ecded965c7b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:26.198537 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca4ac9e773b490dbe46f1725cb5e340', 'request_id': 'req-05f39bfb-29f4-4ff3-b383-3ecded965c7b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:26.206325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca4ac9e773b490dbe46f1725cb5e340', 'request_id': 'req-05f39bfb-29f4-4ff3-b383-3ecded965c7b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:26.240164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1096/2168] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:26 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:53:26.245634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec61d9-05e7-439c-a307-010dcc1ed2cd admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:26.357633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] The token cache is being invalidate because project aca4ac9e773b490dbe46f1725cb5e340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:26.359535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:26.359637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05f39bfb-29f4-4ff3-b383-3ecded965c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:26.365932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1073/2169] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:25 2022] DELETE /identity/v3/projects/aca4ac9e773b490dbe46f1725cb5e340 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:26.372947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968113-d48a-4590-87fd-d4ee30d59c83 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.372947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968113-d48a-4590-87fd-d4ee30d59c83 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.372947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968113-d48a-4590-87fd-d4ee30d59c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:26.418501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ca968113-d48a-4590-87fd-d4ee30d59c83 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:26.419804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ca968113-d48a-4590-87fd-d4ee30d59c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:26.466372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec61d9-05e7-439c-a307-010dcc1ed2cd admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:26.492501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc2eb2-00e4-4453-8943-7116e0a9a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:26.495027 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc2eb2-00e4-4453-8943-7116e0a9a710 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.500243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc2eb2-00e4-4453-8943-7116e0a9a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.502378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc2eb2-00e4-4453-8943-7116e0a9a710 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:26.503314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc2eb2-00e4-4453-8943-7116e0a9a710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:26.506913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc2eb2-00e4-4453-8943-7116e0a9a710 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:26.561902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1074/2170] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:26.569632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca968113-d48a-4590-87fd-d4ee30d59c83 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:26.572087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ca968113-d48a-4590-87fd-d4ee30d59c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:26.585119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca968113-d48a-4590-87fd-d4ee30d59c83 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:26.590386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:26.591327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.591665 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.591947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] PATH_INFO: `/v3/users/94b6bd0ae98249bca84cd96c04fe4959` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:26.593233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b6bd0ae98249bca84cd96c04fe4959)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:26.595183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:26.716124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1097/2171] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:26 2022] POST /identity/v3/users => generated 293 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:26.721471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62e0a-80c4-446c-9ea2-c203d02de73f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.721766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62e0a-80c4-446c-9ea2-c203d02de73f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.722050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62e0a-80c4-446c-9ea2-c203d02de73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:26.778015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-40d62e0a-80c4-446c-9ea2-c203d02de73f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:26.779733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-40d62e0a-80c4-446c-9ea2-c203d02de73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:26.792434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1098/2172] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:26.793608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62e0a-80c4-446c-9ea2-c203d02de73f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:26.797002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-40d62e0a-80c4-446c-9ea2-c203d02de73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:26.819587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62e0a-80c4-446c-9ea2-c203d02de73f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:26.826660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa47df-7269-4310-a982-ad6ddc22d2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:26.827683 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa47df-7269-4310-a982-ad6ddc22d2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.827970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa47df-7269-4310-a982-ad6ddc22d2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.828251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa47df-7269-4310-a982-ad6ddc22d2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:26.829044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa47df-7269-4310-a982-ad6ddc22d2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:26.831560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa47df-7269-4310-a982-ad6ddc22d2a4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:26.860902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b6bd0ae98249bca84cd96c04fe4959'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:26.861431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1099/2173] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:26.865634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa47df-7269-4310-a982-ad6ddc22d2a4 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:26.869847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b6bd0ae98249bca84cd96c04fe4959'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:26.877911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa47df-7269-4310-a982-ad6ddc22d2a4 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:26.886922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05554e-2083-4eb2-9e3f-f74d5da7f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:26.887749 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05554e-2083-4eb2-9e3f-f74d5da7f449 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.888037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05554e-2083-4eb2-9e3f-f74d5da7f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.888369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05554e-2083-4eb2-9e3f-f74d5da7f449 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:26.889242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05554e-2083-4eb2-9e3f-f74d5da7f449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:53:26.889603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05554e-2083-4eb2-9e3f-f74d5da7f449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:26.891571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05554e-2083-4eb2-9e3f-f74d5da7f449 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:26.915639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1100/2174] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:53:26.918194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05554e-2083-4eb2-9e3f-f74d5da7f449 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:26.934188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05554e-2083-4eb2-9e3f-f74d5da7f449 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:26.940588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b6bd0ae98249bca84cd96c04fe4959'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:26.941220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b6bd0ae98249bca84cd96c04fe4959'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:26.942104 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b6bd0ae98249bca84cd96c04fe4959'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:26.948701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7c52c-2289-43a8-b78b-b2b92bafd3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:26.950564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7c52c-2289-43a8-b78b-b2b92bafd3ad admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.950846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7c52c-2289-43a8-b78b-b2b92bafd3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.951132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7c52c-2289-43a8-b78b-b2b92bafd3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:26.953772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7c52c-2289-43a8-b78b-b2b92bafd3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:26.956241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7c52c-2289-43a8-b78b-b2b92bafd3ad admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:26.985876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1075/2175] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:26 2022] DELETE /identity/v3/users/94b6bd0ae98249bca84cd96c04fe4959 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:26.986972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:26.990279 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:26.998031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1101/2176] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:26.998031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b2f6-82fb-41f4-9410-43d07a90a833 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:26.998031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b2f6-82fb-41f4-9410-43d07a90a833 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:26.998031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b2f6-82fb-41f4-9410-43d07a90a833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:27.024225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-cbe5b2f6-82fb-41f4-9410-43d07a90a833 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:27.026085 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-cbe5b2f6-82fb-41f4-9410-43d07a90a833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:27.113990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:27.120059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1102/2177] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:27.120059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b2f6-82fb-41f4-9410-43d07a90a833 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:27.120059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-cbe5b2f6-82fb-41f4-9410-43d07a90a833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:27.135736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b2f6-82fb-41f4-9410-43d07a90a833 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:27.141455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162be8c-f59d-4ae9-8b4e-e06f5f0b88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:27.143595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162be8c-f59d-4ae9-8b4e-e06f5f0b88a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:27.143890 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162be8c-f59d-4ae9-8b4e-e06f5f0b88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:27.144171 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162be8c-f59d-4ae9-8b4e-e06f5f0b88a6 admin admin] PATH_INFO: `/v3/projects/8b273c69bc7f44928c9212fa1da9261e/users/f72f71dd6b8947d280a9a8efe646c2cf/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:27.156696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481129b-4244-45dd-82c0-edf0f4827bb6 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:27.163068 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162be8c-f59d-4ae9-8b4e-e06f5f0b88a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b273c69bc7f44928c9212fa1da9261e, user_id=f72f71dd6b8947d280a9a8efe646c2cf, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:27.164091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78187535-ef48-446e-91d7-590e60542698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:27.165757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78187535-ef48-446e-91d7-590e60542698 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:27.166229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78187535-ef48-446e-91d7-590e60542698 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:27.166661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78187535-ef48-446e-91d7-590e60542698 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:27.167031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162be8c-f59d-4ae9-8b4e-e06f5f0b88a6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:27.167870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78187535-ef48-446e-91d7-590e60542698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:27.169980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78187535-ef48-446e-91d7-590e60542698 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:27.275443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1103/2178] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:27 2022] PUT /identity/v3/projects/8b273c69bc7f44928c9212fa1da9261e/users/f72f71dd6b8947d280a9a8efe646c2cf/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:27.277142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162be8c-f59d-4ae9-8b4e-e06f5f0b88a6 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:27.279558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7162be8c-f59d-4ae9-8b4e-e06f5f0b88a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:27.308832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1076/2179] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:26 2022] POST /identity/v3/projects => generated 385 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:27.314053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79a994-2b46-4b05-b353-78184c157982 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:27.314349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79a994-2b46-4b05-b353-78184c157982 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:27.314637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79a994-2b46-4b05-b353-78184c157982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:27.389298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162be8c-f59d-4ae9-8b4e-e06f5f0b88a6 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:27.398113 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-bc79a994-2b46-4b05-b353-78184c157982 None None] MFA Rules not processed for user `f72f71dd6b8947d280a9a8efe646c2cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:27.400160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-bc79a994-2b46-4b05-b353-78184c157982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:27.502760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637de27-0359-4db7-abff-c1242a8473fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:27.504030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637de27-0359-4db7-abff-c1242a8473fd service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:27.510940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637de27-0359-4db7-abff-c1242a8473fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:27.510940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637de27-0359-4db7-abff-c1242a8473fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:27.563686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1077/2180] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:27.565126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79a994-2b46-4b05-b353-78184c157982 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:27.666407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637de27-0359-4db7-abff-c1242a8473fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:27.669369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637de27-0359-4db7-abff-c1242a8473fd service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:27.686446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79a994-2b46-4b05-b353-78184c157982 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:27.692692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1104/2181] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:27.692692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637de27-0359-4db7-abff-c1242a8473fd service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:27.693008 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eb360-7938-47c9-8943-c304743656ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:27.694209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eb360-7938-47c9-8943-c304743656ec admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:27.694492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eb360-7938-47c9-8943-c304743656ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:27.694999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eb360-7938-47c9-8943-c304743656ec admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:27.709298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eb360-7938-47c9-8943-c304743656ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:27.712247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eb360-7938-47c9-8943-c304743656ec admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:27.714602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637de27-0359-4db7-abff-c1242a8473fd service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:27.731572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6812f-eb47-4a62-9476-cdca100b0c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:27.733140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6812f-eb47-4a62-9476-cdca100b0c06 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:27.733476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6812f-eb47-4a62-9476-cdca100b0c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:27.733765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6812f-eb47-4a62-9476-cdca100b0c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:27.734891 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6812f-eb47-4a62-9476-cdca100b0c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:27.743555 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6812f-eb47-4a62-9476-cdca100b0c06 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:27.871143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1078/2182] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:27 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:27.875889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eb360-7938-47c9-8943-c304743656ec admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:27.911143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1105/2183] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:27 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:27.912935 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eb360-7938-47c9-8943-c304743656ec admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:27.916264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6812f-eb47-4a62-9476-cdca100b0c06 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:28.049202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6812f-eb47-4a62-9476-cdca100b0c06 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:28.056620 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851d61b-bba1-469f-825a-603b679f99cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:28.057677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d61b-bba1-469f-825a-603b679f99cf admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.058387 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d61b-bba1-469f-825a-603b679f99cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.066377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a153c-b03a-4baf-91c8-c9fc483ca398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:28.067637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a153c-b03a-4baf-91c8-c9fc483ca398 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.068079 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a153c-b03a-4baf-91c8-c9fc483ca398 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.078945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a153c-b03a-4baf-91c8-c9fc483ca398 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.078945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a153c-b03a-4baf-91c8-c9fc483ca398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:28.078945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a153c-b03a-4baf-91c8-c9fc483ca398 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:28.079198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d61b-bba1-469f-825a-603b679f99cf admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.079198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851d61b-bba1-469f-825a-603b679f99cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:28.079198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851d61b-bba1-469f-825a-603b679f99cf admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:28.084274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1079/2184] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:28.090502 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a153c-b03a-4baf-91c8-c9fc483ca398 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:28.106832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a153c-b03a-4baf-91c8-c9fc483ca398 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:28.119956 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33854a32-982e-4ed1-ba2e-1a7339828e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:28.120947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33854a32-982e-4ed1-ba2e-1a7339828e65 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.121708 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33854a32-982e-4ed1-ba2e-1a7339828e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.122286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33854a32-982e-4ed1-ba2e-1a7339828e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.123435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33854a32-982e-4ed1-ba2e-1a7339828e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:28.125550 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33854a32-982e-4ed1-ba2e-1a7339828e65 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:28.158987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1080/2185] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:53:28.162131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33854a32-982e-4ed1-ba2e-1a7339828e65 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:28.188418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33854a32-982e-4ed1-ba2e-1a7339828e65 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:28.194054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821f11-abee-45ef-8fff-6e4923b264de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:28.195090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821f11-abee-45ef-8fff-6e4923b264de admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.195547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821f11-abee-45ef-8fff-6e4923b264de admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.196236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821f11-abee-45ef-8fff-6e4923b264de admin admin] PATH_INFO: `/v3/projects/45a0a44acc444e8eb9bba54a8e089f17/users/b9ab8c84c68b4275b2f81b69d8a52826/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.214632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1106/2186] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:27 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:53:28.218283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851d61b-bba1-469f-825a-603b679f99cf admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:28.245262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821f11-abee-45ef-8fff-6e4923b264de admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a0a44acc444e8eb9bba54a8e089f17, user_id=b9ab8c84c68b4275b2f81b69d8a52826, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:28.250997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821f11-abee-45ef-8fff-6e4923b264de admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:28.260661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851d61b-bba1-469f-825a-603b679f99cf admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:28.266991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29e50-cf30-4026-9417-f1a9afa16719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:28.267967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29e50-cf30-4026-9417-f1a9afa16719 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.268260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29e50-cf30-4026-9417-f1a9afa16719 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.268617 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e29e50-cf30-4026-9417-f1a9afa16719 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.269379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29e50-cf30-4026-9417-f1a9afa16719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:28.271195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e29e50-cf30-4026-9417-f1a9afa16719 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:28.308032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1107/2187] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:28.309798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29e50-cf30-4026-9417-f1a9afa16719 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:28.341861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e29e50-cf30-4026-9417-f1a9afa16719 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:28.358936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e5113-3a28-4389-b022-0aeb70972ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:28.367043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e5113-3a28-4389-b022-0aeb70972ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.367449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e5113-3a28-4389-b022-0aeb70972ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.367721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e5113-3a28-4389-b022-0aeb70972ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.369068 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e5113-3a28-4389-b022-0aeb70972ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:28.371036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e5113-3a28-4389-b022-0aeb70972ce5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:28.388288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1081/2188] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:28 2022] PUT /identity/v3/projects/45a0a44acc444e8eb9bba54a8e089f17/users/b9ab8c84c68b4275b2f81b69d8a52826/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:28.390491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caca04-3638-46b0-afdf-af2467777663 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.390491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caca04-3638-46b0-afdf-af2467777663 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.391136 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caca04-3638-46b0-afdf-af2467777663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.426363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1108/2189] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:28.431014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e5113-3a28-4389-b022-0aeb70972ce5 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:28.442667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-44caca04-3638-46b0-afdf-af2467777663 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:28.449007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-44caca04-3638-46b0-afdf-af2467777663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:28.467718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e5113-3a28-4389-b022-0aeb70972ce5 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:28.500963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:28.608934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5c101-6fdb-469d-a8ea-2f03a3a4c5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:28.622640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5c101-6fdb-469d-a8ea-2f03a3a4c5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.622640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5c101-6fdb-469d-a8ea-2f03a3a4c5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.622823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5c101-6fdb-469d-a8ea-2f03a3a4c5b8 admin admin] PATH_INFO: `/v3/projects/ac281b4fc5064778969e5efb21e3ff84/users/43a41b9f8f824a2a8c3f6e07dd27b1da/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.623984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1082/2190] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:28.625097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caca04-3638-46b0-afdf-af2467777663 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:28.626500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-44caca04-3638-46b0-afdf-af2467777663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:28.646317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caca04-3638-46b0-afdf-af2467777663 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:28.651272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5c101-6fdb-469d-a8ea-2f03a3a4c5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac281b4fc5064778969e5efb21e3ff84, user_id=43a41b9f8f824a2a8c3f6e07dd27b1da, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:28.652525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:28.653416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.653705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.654086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] PATH_INFO: `/v3/projects/f16d7f184d264adb88ce761ce5356a5b` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.655426 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16d7f184d264adb88ce761ce5356a5b)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:28.656580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5c101-6fdb-469d-a8ea-2f03a3a4c5b8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:28.657360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:28.741519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1109/2191] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:28 2022] PUT /identity/v3/projects/ac281b4fc5064778969e5efb21e3ff84/users/43a41b9f8f824a2a8c3f6e07dd27b1da/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:28.751481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5c101-6fdb-469d-a8ea-2f03a3a4c5b8 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:28.782831 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16d7f184d264adb88ce761ce5356a5b', 'request_id': 'req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:28.790405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16d7f184d264adb88ce761ce5356a5b', 'request_id': 'req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:28.799070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16d7f184d264adb88ce761ce5356a5b', 'request_id': 'req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:28.803440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5c101-6fdb-469d-a8ea-2f03a3a4c5b8 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:28.885032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8ff72-a30f-4dd4-b728-2843954035cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:28.886053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8ff72-a30f-4dd4-b728-2843954035cb service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.886376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8ff72-a30f-4dd4-b728-2843954035cb service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.886734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8ff72-a30f-4dd4-b728-2843954035cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.895644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] The token cache is being invalidate because project f16d7f184d264adb88ce761ce5356a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:28.897749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:28.897957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-19bc27b6-7bcb-4c47-8194-fc32ee83fbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:28.902890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1083/2192] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:28 2022] DELETE /identity/v3/projects/f16d7f184d264adb88ce761ce5356a5b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:28.904348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447542-6e01-43f2-9c4d-391e84629f40 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:28.906316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447542-6e01-43f2-9c4d-391e84629f40 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:28.907062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447542-6e01-43f2-9c4d-391e84629f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:28.958004 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-be447542-6e01-43f2-9c4d-391e84629f40 None None] MFA Rules not processed for user `43a41b9f8f824a2a8c3f6e07dd27b1da`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:28.959900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-be447542-6e01-43f2-9c4d-391e84629f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:29.011962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8ff72-a30f-4dd4-b728-2843954035cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:29.015907 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8ff72-a30f-4dd4-b728-2843954035cb service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:29.034375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1110/2193] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:29.045115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce93e56-5e56-4199-bd99-aa4390bcc2e8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.045416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce93e56-5e56-4199-bd99-aa4390bcc2e8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.045703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce93e56-5e56-4199-bd99-aa4390bcc2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.080330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-6ce93e56-5e56-4199-bd99-aa4390bcc2e8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:29.081717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6ce93e56-5e56-4199-bd99-aa4390bcc2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:29.093880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1084/2194] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:29.100130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be447542-6e01-43f2-9c4d-391e84629f40 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.101959 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1111/2195] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:29.109604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-be447542-6e01-43f2-9c4d-391e84629f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:29.111487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943614a-82d5-4405-8d11-3eca375f5554 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.111782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943614a-82d5-4405-8d11-3eca375f5554 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.112059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943614a-82d5-4405-8d11-3eca375f5554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.129763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be447542-6e01-43f2-9c4d-391e84629f40 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:29.135720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdef434-3353-4ceb-b381-593092a03970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:29.136546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdef434-3353-4ceb-b381-593092a03970 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.136922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdef434-3353-4ceb-b381-593092a03970 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.137339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdef434-3353-4ceb-b381-593092a03970 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.138271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdef434-3353-4ceb-b381-593092a03970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:29.139975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-c943614a-82d5-4405-8d11-3eca375f5554 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:29.140755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdef434-3353-4ceb-b381-593092a03970 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:29.141265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c943614a-82d5-4405-8d11-3eca375f5554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:29.162257 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1112/2196] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:29.163479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943614a-82d5-4405-8d11-3eca375f5554 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.180441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943614a-82d5-4405-8d11-3eca375f5554 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:29.188130 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0c28f-266a-4b57-8d2e-e1ff53c2b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:29.189060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c28f-266a-4b57-8d2e-e1ff53c2b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.189666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c28f-266a-4b57-8d2e-e1ff53c2b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.190043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0c28f-266a-4b57-8d2e-e1ff53c2b5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.191112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0c28f-266a-4b57-8d2e-e1ff53c2b5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:53:29.191671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0c28f-266a-4b57-8d2e-e1ff53c2b5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:29.193576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0c28f-266a-4b57-8d2e-e1ff53c2b5d1 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:29.218211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1113/2197] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:53:29.219463 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0c28f-266a-4b57-8d2e-e1ff53c2b5d1 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.236281 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1085/2198] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:29 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:53:29.237072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0c28f-266a-4b57-8d2e-e1ff53c2b5d1 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:29.237716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdef434-3353-4ceb-b381-593092a03970 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.340974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6f019-9627-4dae-a96a-b2c4b029aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:29.341957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6f019-9627-4dae-a96a-b2c4b029aca8 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.342404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6f019-9627-4dae-a96a-b2c4b029aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.343037 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6f019-9627-4dae-a96a-b2c4b029aca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.343983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6f019-9627-4dae-a96a-b2c4b029aca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:29.346208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6f019-9627-4dae-a96a-b2c4b029aca8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:29.372948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdef434-3353-4ceb-b381-593092a03970 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:29.384757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac67b25-189e-4982-9993-e2cb590309a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:29.386965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac67b25-189e-4982-9993-e2cb590309a4 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.386965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac67b25-189e-4982-9993-e2cb590309a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.386965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac67b25-189e-4982-9993-e2cb590309a4 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.387721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac67b25-189e-4982-9993-e2cb590309a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:29.391195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac67b25-189e-4982-9993-e2cb590309a4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:29.457716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1114/2199] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:29 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:29.461939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6f019-9627-4dae-a96a-b2c4b029aca8 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.521227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1086/2200] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:29 2022] POST /identity/v3/users => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:29.527814 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac67b25-189e-4982-9993-e2cb590309a4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.560383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6f019-9627-4dae-a96a-b2c4b029aca8 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:29.578171 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87990d43-34a5-43d7-866b-e58bba57ac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:29.579003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87990d43-34a5-43d7-866b-e58bba57ac1a admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.579569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac67b25-189e-4982-9993-e2cb590309a4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:29.580533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87990d43-34a5-43d7-866b-e58bba57ac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.581262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87990d43-34a5-43d7-866b-e58bba57ac1a admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.582889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87990d43-34a5-43d7-866b-e58bba57ac1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:29.587508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87990d43-34a5-43d7-866b-e58bba57ac1a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:29.610803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a170e24-58b0-4edc-9149-ef317de87fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:29.615058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a170e24-58b0-4edc-9149-ef317de87fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.615058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a170e24-58b0-4edc-9149-ef317de87fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.616735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a170e24-58b0-4edc-9149-ef317de87fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.618169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a170e24-58b0-4edc-9149-ef317de87fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:29.623373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a170e24-58b0-4edc-9149-ef317de87fb1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:29.643048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1087/2201] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:29.644628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a170e24-58b0-4edc-9149-ef317de87fb1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.670150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a170e24-58b0-4edc-9149-ef317de87fb1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:29.677483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004bbaf-dc07-402c-91e0-e1d561baefee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:29.678627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004bbaf-dc07-402c-91e0-e1d561baefee admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.679062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004bbaf-dc07-402c-91e0-e1d561baefee admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.679522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004bbaf-dc07-402c-91e0-e1d561baefee admin admin] PATH_INFO: `/v3/projects/740134ec12bb48fd8dc109bcdb7a103d/users/da18ebf352fb4c578d565b20ec5ed5a8/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.709237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004bbaf-dc07-402c-91e0-e1d561baefee admin admin] RBAC: Authorizing `identity:create_grant(project_id=740134ec12bb48fd8dc109bcdb7a103d, user_id=da18ebf352fb4c578d565b20ec5ed5a8, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:29.714996 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004bbaf-dc07-402c-91e0-e1d561baefee admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:29.736204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1115/2202] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:29 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:53:29.741312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87990d43-34a5-43d7-866b-e58bba57ac1a admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.758112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87990d43-34a5-43d7-866b-e58bba57ac1a admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:29.764070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad413-e35b-4109-97f3-58a50bc753b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:29.765366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad413-e35b-4109-97f3-58a50bc753b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.765366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad413-e35b-4109-97f3-58a50bc753b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.765541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad413-e35b-4109-97f3-58a50bc753b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.766376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ad413-e35b-4109-97f3-58a50bc753b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:29.768162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ad413-e35b-4109-97f3-58a50bc753b6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:29.790863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1116/2203] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:29.802693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad413-e35b-4109-97f3-58a50bc753b6 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.815300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad413-e35b-4109-97f3-58a50bc753b6 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:29.826304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5588e8b-b6e2-4100-8353-b5881c213c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:29.827328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588e8b-b6e2-4100-8353-b5881c213c58 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.828301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588e8b-b6e2-4100-8353-b5881c213c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.828775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588e8b-b6e2-4100-8353-b5881c213c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:29.830176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5588e8b-b6e2-4100-8353-b5881c213c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:29.837012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5588e8b-b6e2-4100-8353-b5881c213c58 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:29.850425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1088/2204] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:29 2022] PUT /identity/v3/projects/740134ec12bb48fd8dc109bcdb7a103d/users/da18ebf352fb4c578d565b20ec5ed5a8/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:29.854622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1117/2205] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:29.858082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004bbaf-dc07-402c-91e0-e1d561baefee admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.858395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5588e8b-b6e2-4100-8353-b5881c213c58 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:29.887171 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5588e8b-b6e2-4100-8353-b5881c213c58 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:29.990154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cdf3f-0e88-4e92-9c77-a1def4e955a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:29.994275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cdf3f-0e88-4e92-9c77-a1def4e955a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:29.995381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cdf3f-0e88-4e92-9c77-a1def4e955a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:29.997232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cdf3f-0e88-4e92-9c77-a1def4e955a4 admin admin] PATH_INFO: `/v3/projects/f61190c709d04d18b46e15d36f7388fe/users/abf7636bd87d44c7a7f462ff9ce2f1f7/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:30.033919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004bbaf-dc07-402c-91e0-e1d561baefee admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:30.045167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cdf3f-0e88-4e92-9c77-a1def4e955a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61190c709d04d18b46e15d36f7388fe, user_id=abf7636bd87d44c7a7f462ff9ce2f1f7, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:30.048789 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cdf3f-0e88-4e92-9c77-a1def4e955a4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:30.050241 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245410e-7674-4a67-baab-8a335641336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:30.051496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245410e-7674-4a67-baab-8a335641336f admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:30.051831 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245410e-7674-4a67-baab-8a335641336f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:30.052300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245410e-7674-4a67-baab-8a335641336f admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:30.054244 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245410e-7674-4a67-baab-8a335641336f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:30.057340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245410e-7674-4a67-baab-8a335641336f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:30.071673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1089/2206] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:53:30.077239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245410e-7674-4a67-baab-8a335641336f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:30.095981 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245410e-7674-4a67-baab-8a335641336f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:30.104041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fc7eb-e37a-4f99-8757-f77353aacab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:30.106052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fc7eb-e37a-4f99-8757-f77353aacab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:30.106528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fc7eb-e37a-4f99-8757-f77353aacab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:30.106966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fc7eb-e37a-4f99-8757-f77353aacab7 admin admin] PATH_INFO: `/v3/projects/740134ec12bb48fd8dc109bcdb7a103d/users/da18ebf352fb4c578d565b20ec5ed5a8/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:30.109481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fc7eb-e37a-4f99-8757-f77353aacab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740134ec12bb48fd8dc109bcdb7a103d, user_id=da18ebf352fb4c578d565b20ec5ed5a8, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:30.112389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fc7eb-e37a-4f99-8757-f77353aacab7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:30.122610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1118/2207] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:29 2022] PUT /identity/v3/projects/f61190c709d04d18b46e15d36f7388fe/users/abf7636bd87d44c7a7f462ff9ce2f1f7/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:30.125095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d32d-b5c3-44c2-8f30-9e74b4a5693b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:30.126345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d32d-b5c3-44c2-8f30-9e74b4a5693b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:30.126826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3d32d-b5c3-44c2-8f30-9e74b4a5693b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:30.157813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1090/2208] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:30 2022] PUT /identity/v3/projects/740134ec12bb48fd8dc109bcdb7a103d/users/da18ebf352fb4c578d565b20ec5ed5a8/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:30.170356 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34af70-85aa-48e0-a4a5-4700b3a5c8cf None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:30.170895 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34af70-85aa-48e0-a4a5-4700b3a5c8cf None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:30.182095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34af70-85aa-48e0-a4a5-4700b3a5c8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:30.182245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-4bc3d32d-b5c3-44c2-8f30-9e74b4a5693b None None] MFA Rules not processed for user `abf7636bd87d44c7a7f462ff9ce2f1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:30.182423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4bc3d32d-b5c3-44c2-8f30-9e74b4a5693b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:30.205055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-cf34af70-85aa-48e0-a4a5-4700b3a5c8cf None None] MFA Rules not processed for user `da18ebf352fb4c578d565b20ec5ed5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:30.209563 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-cf34af70-85aa-48e0-a4a5-4700b3a5c8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:30.349691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1091/2209] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:30.355782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1119/2210] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:30.363677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34af70-85aa-48e0-a4a5-4700b3a5c8cf None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:30.365284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3d32d-b5c3-44c2-8f30-9e74b4a5693b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:30.369678 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-cf34af70-85aa-48e0-a4a5-4700b3a5c8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:30.372042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4bc3d32d-b5c3-44c2-8f30-9e74b4a5693b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:30.510951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3d32d-b5c3-44c2-8f30-9e74b4a5693b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:30.514358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34af70-85aa-48e0-a4a5-4700b3a5c8cf None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:30.516044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c7148-aef1-4f88-81e5-fbb01da66e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:30.516822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c7148-aef1-4f88-81e5-fbb01da66e82 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:30.517241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c7148-aef1-4f88-81e5-fbb01da66e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:30.517669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c7148-aef1-4f88-81e5-fbb01da66e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:30.520410 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9fc0e-0543-46b3-b4f5-c0600d621ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:30.521458 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9fc0e-0543-46b3-b4f5-c0600d621ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:30.521925 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9fc0e-0543-46b3-b4f5-c0600d621ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:30.522481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9fc0e-0543-46b3-b4f5-c0600d621ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:30.526788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d7e9fc0e-0543-46b3-b4f5-c0600d621ab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:30.529511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c7148-aef1-4f88-81e5-fbb01da66e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:30.531102 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c7148-aef1-4f88-81e5-fbb01da66e82 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:30.556387 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1120/2211] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:30.614914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9fc0e-0543-46b3-b4f5-c0600d621ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:30.616957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9fc0e-0543-46b3-b4f5-c0600d621ab5 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:30.632139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1092/2212] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:53:30.936358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:32.123796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:32.601294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4ee39-9524-4cb0-8c5b-0c6024919651 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:32.601819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4ee39-9524-4cb0-8c5b-0c6024919651 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:32.603838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4ee39-9524-4cb0-8c5b-0c6024919651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:32.647861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-44a4ee39-9524-4cb0-8c5b-0c6024919651 None None] MFA Rules not processed for user `fe2ef5a0f3b247c28929b28e03dace2d`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:32.649870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-44a4ee39-9524-4cb0-8c5b-0c6024919651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:32.794236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9fc0e-0543-46b3-b4f5-c0600d621ab5 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:32.794808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1121/2213] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:32.797397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d7e9fc0e-0543-46b3-b4f5-c0600d621ab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:32.909031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9fc0e-0543-46b3-b4f5-c0600d621ab5 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:32.932448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd14bc-4440-4237-9acb-cfb1810e16e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:32.933171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd14bc-4440-4237-9acb-cfb1810e16e0 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:32.933468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd14bc-4440-4237-9acb-cfb1810e16e0 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:32.933879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd14bc-4440-4237-9acb-cfb1810e16e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:32.936778 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-08dd14bc-4440-4237-9acb-cfb1810e16e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:33.041422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd14bc-4440-4237-9acb-cfb1810e16e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:33.042117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd14bc-4440-4237-9acb-cfb1810e16e0 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:33.053670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1093/2214] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:33.061454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4ee39-9524-4cb0-8c5b-0c6024919651 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:33.072491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4ee39-9524-4cb0-8c5b-0c6024919651 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:33.076330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afd21b-2d74-49a3-a0b1-a06106f4ea18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:33.077005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd21b-2d74-49a3-a0b1-a06106f4ea18 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:33.077286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd21b-2d74-49a3-a0b1-a06106f4ea18 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:33.078770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd21b-2d74-49a3-a0b1-a06106f4ea18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:33.146588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afd21b-2d74-49a3-a0b1-a06106f4ea18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:33.148005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afd21b-2d74-49a3-a0b1-a06106f4ea18 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:33.161460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1122/2215] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:34.838899 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:36.032206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:36.067975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd14bc-4440-4237-9acb-cfb1810e16e0 service nova] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:36.093116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd14bc-4440-4237-9acb-cfb1810e16e0 service nova] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:36.106775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4340df-0d1a-4140-82ca-8e95ae1be8b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:36.110862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4340df-0d1a-4140-82ca-8e95ae1be8b0 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:36.113419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4340df-0d1a-4140-82ca-8e95ae1be8b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:36.115763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4340df-0d1a-4140-82ca-8e95ae1be8b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:36.143249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4340df-0d1a-4140-82ca-8e95ae1be8b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:36.148691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4340df-0d1a-4140-82ca-8e95ae1be8b0 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:36.164998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1094/2216] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:37.859096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46669f7b-8eaf-4459-979b-864620c22266 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:37.860062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46669f7b-8eaf-4459-979b-864620c22266 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:37.861017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46669f7b-8eaf-4459-979b-864620c22266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:37.911119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-46669f7b-8eaf-4459-979b-864620c22266 None None] MFA Rules not processed for user `fec25ac241c94d4dbebb361c55f10f75`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:37.918610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-46669f7b-8eaf-4459-979b-864620c22266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:37.928323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1123/2217] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:37.957002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9176a1-af1b-47c5-8541-520e18752eba None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:37.957584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9176a1-af1b-47c5-8541-520e18752eba None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:37.957835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9176a1-af1b-47c5-8541-520e18752eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:38.028394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ea9176a1-af1b-47c5-8541-520e18752eba None None] MFA Rules not processed for user `b9ab8c84c68b4275b2f81b69d8a52826`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:38.030180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ea9176a1-af1b-47c5-8541-520e18752eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:38.043692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:38.128612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1095/2218] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:38.129739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46669f7b-8eaf-4459-979b-864620c22266 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:38.131249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-46669f7b-8eaf-4459-979b-864620c22266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:38.214559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46669f7b-8eaf-4459-979b-864620c22266 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:38.219114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba686b70-b41b-44dd-b26d-b181c93ae862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:38.219814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686b70-b41b-44dd-b26d-b181c93ae862 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:38.220122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686b70-b41b-44dd-b26d-b181c93ae862 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:38.220400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686b70-b41b-44dd-b26d-b181c93ae862 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:38.221114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba686b70-b41b-44dd-b26d-b181c93ae862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:38.223118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba686b70-b41b-44dd-b26d-b181c93ae862 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:38.378126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1124/2219] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:38 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:38.382053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9176a1-af1b-47c5-8541-520e18752eba None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:38.402107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9176a1-af1b-47c5-8541-520e18752eba None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:38.654860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368a76e-1d9c-4f28-98fd-8c3292a70acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:38.673061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368a76e-1d9c-4f28-98fd-8c3292a70acb admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:38.673477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368a76e-1d9c-4f28-98fd-8c3292a70acb admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:38.673837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368a76e-1d9c-4f28-98fd-8c3292a70acb admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:38.677212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368a76e-1d9c-4f28-98fd-8c3292a70acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:38.682569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368a76e-1d9c-4f28-98fd-8c3292a70acb admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:38.871888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1096/2220] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:38 2022] POST /identity/v3/users => generated 298 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:53:38.875884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba686b70-b41b-44dd-b26d-b181c93ae862 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:38.890657 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba686b70-b41b-44dd-b26d-b181c93ae862 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:38.897123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a0439-ce75-410f-9904-861ac06cf8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:38.897889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a0439-ce75-410f-9904-861ac06cf8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:38.898181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a0439-ce75-410f-9904-861ac06cf8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:38.898498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a0439-ce75-410f-9904-861ac06cf8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:38.899312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a0439-ce75-410f-9904-861ac06cf8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:38.901376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a0439-ce75-410f-9904-861ac06cf8c8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:38.914870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1125/2221] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:38.921156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368a76e-1d9c-4f28-98fd-8c3292a70acb admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:38.935940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368a76e-1d9c-4f28-98fd-8c3292a70acb admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:38.942076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bb6e5-0b43-486c-80a7-e464a1062902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:38.943198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bb6e5-0b43-486c-80a7-e464a1062902 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:38.943794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bb6e5-0b43-486c-80a7-e464a1062902 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:38.944481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bb6e5-0b43-486c-80a7-e464a1062902 admin admin] PATH_INFO: `/v3/projects/ccdf4c362cc34ba8b0ae36299712fa90/users/6389cfbc816041baa75d44db9d1c5398/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:38.966166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bb6e5-0b43-486c-80a7-e464a1062902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdf4c362cc34ba8b0ae36299712fa90, user_id=6389cfbc816041baa75d44db9d1c5398, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:38.969952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bb6e5-0b43-486c-80a7-e464a1062902 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:39.067921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:39.110101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1097/2222] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:38 2022] PUT /identity/v3/projects/ccdf4c362cc34ba8b0ae36299712fa90/users/6389cfbc816041baa75d44db9d1c5398/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:39.112799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a0439-ce75-410f-9904-861ac06cf8c8 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:39.128413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a0439-ce75-410f-9904-861ac06cf8c8 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:39.207488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf4cb6-9654-4035-9bfb-91a0a8e66722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:39.208455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf4cb6-9654-4035-9bfb-91a0a8e66722 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:39.208887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf4cb6-9654-4035-9bfb-91a0a8e66722 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:39.214104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf4cb6-9654-4035-9bfb-91a0a8e66722 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:39.214104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf4cb6-9654-4035-9bfb-91a0a8e66722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:39.214104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf4cb6-9654-4035-9bfb-91a0a8e66722 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:39.226207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1126/2223] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:39.231024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bb6e5-0b43-486c-80a7-e464a1062902 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:39.252215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bb6e5-0b43-486c-80a7-e464a1062902 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:39.295159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5258e79-f12c-41b0-a599-64eab51eac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:39.297316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5258e79-f12c-41b0-a599-64eab51eac9a admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:39.297842 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5258e79-f12c-41b0-a599-64eab51eac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:39.298494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5258e79-f12c-41b0-a599-64eab51eac9a admin admin] PATH_INFO: `/v3/projects/ccdf4c362cc34ba8b0ae36299712fa90/users/6389cfbc816041baa75d44db9d1c5398/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:39.302450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5258e79-f12c-41b0-a599-64eab51eac9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdf4c362cc34ba8b0ae36299712fa90, user_id=6389cfbc816041baa75d44db9d1c5398, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:39.308251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5258e79-f12c-41b0-a599-64eab51eac9a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:39.322472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1098/2224] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:39 2022] PUT /identity/v3/projects/ccdf4c362cc34ba8b0ae36299712fa90/users/6389cfbc816041baa75d44db9d1c5398/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:40.464826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:41.266624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:43.181637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:43.245272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:44.849840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf4cb6-9654-4035-9bfb-91a0a8e66722 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:44.871223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf4cb6-9654-4035-9bfb-91a0a8e66722 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:44.974203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:44.975587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:44.976078 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:44.976556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] PATH_INFO: `/v3/users/f72f71dd6b8947d280a9a8efe646c2cf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:44.979051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72f71dd6b8947d280a9a8efe646c2cf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:44.982101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:45.225331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72f71dd6b8947d280a9a8efe646c2cf'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:45.245677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72f71dd6b8947d280a9a8efe646c2cf'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:45.357633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72f71dd6b8947d280a9a8efe646c2cf'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:45.367699 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72f71dd6b8947d280a9a8efe646c2cf'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:45.369188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72f71dd6b8947d280a9a8efe646c2cf'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:45.377700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1127/2225] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:44 2022] DELETE /identity/v3/users/f72f71dd6b8947d280a9a8efe646c2cf => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:45.382224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3781d2-efa2-4898-8596-d93197133916 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:45.383505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3781d2-efa2-4898-8596-d93197133916 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:45.386443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3781d2-efa2-4898-8596-d93197133916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:45.401271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:45.419472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9c3781d2-efa2-4898-8596-d93197133916 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:45.421947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9c3781d2-efa2-4898-8596-d93197133916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:45.472647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:45.517193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1099/2226] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:45.527177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:45.530538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:45.625642 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b951fc8-e330-4794-8ba6-a21d472f19bd admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:45.631144 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f0a09-3c51-4f42-ae1c-08b240595936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:45.632074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f0a09-3c51-4f42-ae1c-08b240595936 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:45.632515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f0a09-3c51-4f42-ae1c-08b240595936 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:45.632958 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f0a09-3c51-4f42-ae1c-08b240595936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:45.645734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f0a09-3c51-4f42-ae1c-08b240595936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:45.648304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f0a09-3c51-4f42-ae1c-08b240595936 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:45.665277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1128/2227] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:46.541314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:46.605321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3781d2-efa2-4898-8596-d93197133916 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:46.606941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9c3781d2-efa2-4898-8596-d93197133916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:46.622841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3781d2-efa2-4898-8596-d93197133916 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:46.648103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:46.651531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:46.652008 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:46.652289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] PATH_INFO: `/v3/projects/8b273c69bc7f44928c9212fa1da9261e` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:46.656598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b273c69bc7f44928c9212fa1da9261e)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:46.659826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:46.835761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584afbf-0921-4b35-bd85-4be28a268601 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:46.836941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584afbf-0921-4b35-bd85-4be28a268601 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:46.842585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584afbf-0921-4b35-bd85-4be28a268601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:46.872210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-4584afbf-0921-4b35-bd85-4be28a268601 None None] MFA Rules not processed for user `6389cfbc816041baa75d44db9d1c5398`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:46.875459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4584afbf-0921-4b35-bd85-4be28a268601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:46.921193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b273c69bc7f44928c9212fa1da9261e', 'request_id': 'req-6ebedb83-f96d-451e-85cf-8fbee4c23df0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:46.933165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b273c69bc7f44928c9212fa1da9261e', 'request_id': 'req-6ebedb83-f96d-451e-85cf-8fbee4c23df0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:46.951115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b273c69bc7f44928c9212fa1da9261e', 'request_id': 'req-6ebedb83-f96d-451e-85cf-8fbee4c23df0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:46.980224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1129/2228] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:47.007184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584afbf-0921-4b35-bd85-4be28a268601 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:47.027330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4584afbf-0921-4b35-bd85-4be28a268601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:47.096095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584afbf-0921-4b35-bd85-4be28a268601 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:47.119919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] The token cache is being invalidate because project 8b273c69bc7f44928c9212fa1da9261e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:47.120610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:47.121628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:47.124319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1100/2229] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:46 2022] DELETE /identity/v3/projects/8b273c69bc7f44928c9212fa1da9261e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:47.134263 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:47.135873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:47.182486 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fca1e-2667-4d93-b701-ace01495b512 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd039be6500e74ae3a6f30821c5c19a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:47.183581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fca1e-2667-4d93-b701-ace01495b512 service glance] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:47.184009 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fca1e-2667-4d93-b701-ace01495b512 service glance] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:47.184732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fca1e-2667-4d93-b701-ace01495b512 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:47.187707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a84fca1e-2667-4d93-b701-ace01495b512 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:47.252353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebedb83-f96d-451e-85cf-8fbee4c23df0 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:47.259771 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:47.261060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:47.261623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:47.262145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] PATH_INFO: `/v3/users/43a41b9f8f824a2a8c3f6e07dd27b1da` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:47.264030 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a41b9f8f824a2a8c3f6e07dd27b1da)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:47.268404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:47.290028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fca1e-2667-4d93-b701-ace01495b512 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:47.291577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fca1e-2667-4d93-b701-ace01495b512 service glance] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:47.301137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1130/2230] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:53:47.352551 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:47.519757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a41b9f8f824a2a8c3f6e07dd27b1da'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:47.526811 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a41b9f8f824a2a8c3f6e07dd27b1da'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:47.622530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35982b73-0c9f-4230-abca-ba84682ac834 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:47.622944 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35982b73-0c9f-4230-abca-ba84682ac834 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:47.623300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35982b73-0c9f-4230-abca-ba84682ac834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:47.626743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a41b9f8f824a2a8c3f6e07dd27b1da'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:47.628352 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a41b9f8f824a2a8c3f6e07dd27b1da'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:47.629200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a41b9f8f824a2a8c3f6e07dd27b1da'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:47.651307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1101/2231] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:47 2022] DELETE /identity/v3/users/43a41b9f8f824a2a8c3f6e07dd27b1da => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:47.664145 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-35982b73-0c9f-4230-abca-ba84682ac834 None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:47.669636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-35982b73-0c9f-4230-abca-ba84682ac834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:47.744927 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1131/2232] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:53:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:47.795129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:47.796717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:47.874425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247627c-3d76-4ddb-b0e1-73037fe19bc5 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:47.892383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67428cd-6cc8-4c26-9aa1-bcbee0efed93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:47.893082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67428cd-6cc8-4c26-9aa1-bcbee0efed93 service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:47.893368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67428cd-6cc8-4c26-9aa1-bcbee0efed93 service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:47.893652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67428cd-6cc8-4c26-9aa1-bcbee0efed93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:47.903933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67428cd-6cc8-4c26-9aa1-bcbee0efed93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:47.905729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67428cd-6cc8-4c26-9aa1-bcbee0efed93 service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:47.923613 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1102/2233] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:53:48.485732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35982b73-0c9f-4230-abca-ba84682ac834 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:48.487826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-35982b73-0c9f-4230-abca-ba84682ac834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:48.667021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35982b73-0c9f-4230-abca-ba84682ac834 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:48.667021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:48.667021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:48.667021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:48.667862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] PATH_INFO: `/v3/projects/ac281b4fc5064778969e5efb21e3ff84` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:48.667862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac281b4fc5064778969e5efb21e3ff84)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:48.667862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:48.806784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:49.047920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac281b4fc5064778969e5efb21e3ff84', 'request_id': 'req-2dc0c6c3-1ce0-4a30-906f-75ac42314096'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:49.066110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac281b4fc5064778969e5efb21e3ff84', 'request_id': 'req-2dc0c6c3-1ce0-4a30-906f-75ac42314096'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:49.101667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac281b4fc5064778969e5efb21e3ff84', 'request_id': 'req-2dc0c6c3-1ce0-4a30-906f-75ac42314096'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:49.222144 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] The token cache is being invalidate because project ac281b4fc5064778969e5efb21e3ff84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:49.222851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:49.224067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:49.229965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1132/2234] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:48 2022] DELETE /identity/v3/projects/ac281b4fc5064778969e5efb21e3ff84 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:49.231468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67428cd-6cc8-4c26-9aa1-bcbee0efed93 service swift] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:49.246940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67428cd-6cc8-4c26-9aa1-bcbee0efed93 service swift] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:49.391936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:49.393167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:49.393615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:49.394063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] PATH_INFO: `/v3/users/da18ebf352fb4c578d565b20ec5ed5a8` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:49.396216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da18ebf352fb4c578d565b20ec5ed5a8)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:49.399875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:49.738953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da18ebf352fb4c578d565b20ec5ed5a8'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:49.741719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:49.760230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da18ebf352fb4c578d565b20ec5ed5a8'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:49.868072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da18ebf352fb4c578d565b20ec5ed5a8'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:49.868874 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da18ebf352fb4c578d565b20ec5ed5a8'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:49.869512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-24ed2bbd-0562-462f-a004-5fdab47f11c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da18ebf352fb4c578d565b20ec5ed5a8'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:49.925776 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1103/2235] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:53:49 2022] DELETE /identity/v3/users/da18ebf352fb4c578d565b20ec5ed5a8 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:50.458188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:50.788338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:50.791109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:50.818972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c6c3-1ce0-4a30-906f-75ac42314096 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:50.928342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:50.931177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:50.931177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:50.931177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] PATH_INFO: `/v3/projects/740134ec12bb48fd8dc109bcdb7a103d` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:50.932762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=740134ec12bb48fd8dc109bcdb7a103d)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:50.937958 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:51.148121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740134ec12bb48fd8dc109bcdb7a103d', 'request_id': 'req-de41ec55-b820-4239-81db-fe58acfe7750'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:51.156299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740134ec12bb48fd8dc109bcdb7a103d', 'request_id': 'req-de41ec55-b820-4239-81db-fe58acfe7750'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:51.175862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740134ec12bb48fd8dc109bcdb7a103d', 'request_id': 'req-de41ec55-b820-4239-81db-fe58acfe7750'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:51.292014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:51.296963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] The token cache is being invalidate because project 740134ec12bb48fd8dc109bcdb7a103d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:53:51.298671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:51.299906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-de41ec55-b820-4239-81db-fe58acfe7750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:53:51.305421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1133/2236] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:53:50 2022] DELETE /identity/v3/projects/740134ec12bb48fd8dc109bcdb7a103d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:53:51.311630 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327102c5-00be-4594-aa10-b84d39ed9be3 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:51.312005 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327102c5-00be-4594-aa10-b84d39ed9be3 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:51.312351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327102c5-00be-4594-aa10-b84d39ed9be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:51.334027 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-327102c5-00be-4594-aa10-b84d39ed9be3 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:51.335487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-327102c5-00be-4594-aa10-b84d39ed9be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:51.416292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1104/2237] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:51.425654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92260ae9-3438-4558-a2bd-f42532c77a2d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:51.425944 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92260ae9-3438-4558-a2bd-f42532c77a2d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:51.426687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92260ae9-3438-4558-a2bd-f42532c77a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:51.481260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-92260ae9-3438-4558-a2bd-f42532c77a2d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:51.482705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-92260ae9-3438-4558-a2bd-f42532c77a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:51.510690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1134/2238] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:53:51.514610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327102c5-00be-4594-aa10-b84d39ed9be3 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:51.531908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327102c5-00be-4594-aa10-b84d39ed9be3 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:51.542201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea8ada-c423-436a-b501-9c8a1baeadd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:51.542779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea8ada-c423-436a-b501-9c8a1baeadd5 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:51.543055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea8ada-c423-436a-b501-9c8a1baeadd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:51.543340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea8ada-c423-436a-b501-9c8a1baeadd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:51.544101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea8ada-c423-436a-b501-9c8a1baeadd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:53:51.544596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea8ada-c423-436a-b501-9c8a1baeadd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:51.546901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea8ada-c423-436a-b501-9c8a1baeadd5 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:51.606954 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1105/2239] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:53:51.608420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92260ae9-3438-4558-a2bd-f42532c77a2d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:51.618566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92260ae9-3438-4558-a2bd-f42532c77a2d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:51.625332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344ff9b-6e47-4d0e-a4de-f645c5e8d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:51.626266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344ff9b-6e47-4d0e-a4de-f645c5e8d718 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:51.626704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344ff9b-6e47-4d0e-a4de-f645c5e8d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:51.627125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344ff9b-6e47-4d0e-a4de-f645c5e8d718 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:51.628091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344ff9b-6e47-4d0e-a4de-f645c5e8d718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:51.630315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344ff9b-6e47-4d0e-a4de-f645c5e8d718 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:51.765122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1135/2240] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:53:51 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:53:51.766166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea8ada-c423-436a-b501-9c8a1baeadd5 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:51.783824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea8ada-c423-436a-b501-9c8a1baeadd5 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:51.960247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b26aef-02f0-4c8e-bb88-65f3ba2d12a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:51.961213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b26aef-02f0-4c8e-bb88-65f3ba2d12a0 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:51.961853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b26aef-02f0-4c8e-bb88-65f3ba2d12a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:51.962301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b26aef-02f0-4c8e-bb88-65f3ba2d12a0 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:51.963218 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b26aef-02f0-4c8e-bb88-65f3ba2d12a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:51.965322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b26aef-02f0-4c8e-bb88-65f3ba2d12a0 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:52.088559 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1106/2241] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:53:51 2022] POST /identity/v3/users => generated 287 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:53:52.090401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344ff9b-6e47-4d0e-a4de-f645c5e8d718 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:52.107361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344ff9b-6e47-4d0e-a4de-f645c5e8d718 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:52.116672 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9f1e7-5807-4e0a-b47c-1d4968b2bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:52.117787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9f1e7-5807-4e0a-b47c-1d4968b2bb40 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:52.118072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9f1e7-5807-4e0a-b47c-1d4968b2bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:52.118347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9f1e7-5807-4e0a-b47c-1d4968b2bb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:52.120327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9f1e7-5807-4e0a-b47c-1d4968b2bb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:52.122148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9f1e7-5807-4e0a-b47c-1d4968b2bb40 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:52.159729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1136/2242] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:52.161532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b26aef-02f0-4c8e-bb88-65f3ba2d12a0 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:52.173436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b26aef-02f0-4c8e-bb88-65f3ba2d12a0 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:52.178501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55472549-83f5-4112-9cca-3a513f0faf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:52.179449 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55472549-83f5-4112-9cca-3a513f0faf4e admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:52.179932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55472549-83f5-4112-9cca-3a513f0faf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:52.180525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55472549-83f5-4112-9cca-3a513f0faf4e admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:52.181723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55472549-83f5-4112-9cca-3a513f0faf4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:52.183381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55472549-83f5-4112-9cca-3a513f0faf4e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:52.196248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1107/2243] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:53:52.202515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9f1e7-5807-4e0a-b47c-1d4968b2bb40 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:52.215581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9f1e7-5807-4e0a-b47c-1d4968b2bb40 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:52.222109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:52.225809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5d6ba-cf37-4aef-856d-eb7bf60f8d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:52.227459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5d6ba-cf37-4aef-856d-eb7bf60f8d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:52.233010 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5d6ba-cf37-4aef-856d-eb7bf60f8d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:52.233010 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5d6ba-cf37-4aef-856d-eb7bf60f8d68 admin admin] PATH_INFO: `/v3/projects/f5809f2e310d4768acbf28fb54280f35/users/8885e2308ed64b52afcb6b6e6b67bffe/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:52.264948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5d6ba-cf37-4aef-856d-eb7bf60f8d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5809f2e310d4768acbf28fb54280f35, user_id=8885e2308ed64b52afcb6b6e6b67bffe, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:52.268998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5d6ba-cf37-4aef-856d-eb7bf60f8d68 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:52.355054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1137/2244] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:53:52 2022] PUT /identity/v3/projects/f5809f2e310d4768acbf28fb54280f35/users/8885e2308ed64b52afcb6b6e6b67bffe/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:53:52.366425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc906-920d-4e5f-8728-85e08c0e6a9a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:52.367002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc906-920d-4e5f-8728-85e08c0e6a9a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:52.367002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc906-920d-4e5f-8728-85e08c0e6a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:52.414686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-bb8cc906-920d-4e5f-8728-85e08c0e6a9a None None] MFA Rules not processed for user `8885e2308ed64b52afcb6b6e6b67bffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:52.416125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-bb8cc906-920d-4e5f-8728-85e08c0e6a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:52.551842 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1108/2245] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:52.572629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5d6ba-cf37-4aef-856d-eb7bf60f8d68 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:53:52.574729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1ce5d6ba-cf37-4aef-856d-eb7bf60f8d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:52.692528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5d6ba-cf37-4aef-856d-eb7bf60f8d68 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:53:52.717992 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccc3ae-02ab-45d3-9015-5aa554b47131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:53:52.718825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccc3ae-02ab-45d3-9015-5aa554b47131 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:52.720551 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccc3ae-02ab-45d3-9015-5aa554b47131 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:52.720551 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccc3ae-02ab-45d3-9015-5aa554b47131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:52.739564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccc3ae-02ab-45d3-9015-5aa554b47131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:53:52.739564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccc3ae-02ab-45d3-9015-5aa554b47131 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:53:52.751318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:52.751318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1138/2246] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:53:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:53:52.769680 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:54.675211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:53:55.208259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc837dbf-2062-457a-b49b-1611c8ec43d5 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:55.208834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc837dbf-2062-457a-b49b-1611c8ec43d5 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:55.208834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc837dbf-2062-457a-b49b-1611c8ec43d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:55.230713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-dc837dbf-2062-457a-b49b-1611c8ec43d5 None None] MFA Rules not processed for user `8885e2308ed64b52afcb6b6e6b67bffe`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:55.231972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-dc837dbf-2062-457a-b49b-1611c8ec43d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:55.240233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1109/2247] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:53:59.276730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf1245-ef07-4e8a-9b27-8f59de6a0da3 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:53:59.276730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf1245-ef07-4e8a-9b27-8f59de6a0da3 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:53:59.276730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf1245-ef07-4e8a-9b27-8f59de6a0da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:53:59.318807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-66cf1245-ef07-4e8a-9b27-8f59de6a0da3 None None] MFA Rules not processed for user `01bb3df8b4b649388d1a0f6c24e18f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:53:59.321332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-66cf1245-ef07-4e8a-9b27-8f59de6a0da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:53:59.430913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1139/2248] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:53:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:02.144030 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc837dbf-2062-457a-b49b-1611c8ec43d5 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:02.146240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-dc837dbf-2062-457a-b49b-1611c8ec43d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:02.382640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc837dbf-2062-457a-b49b-1611c8ec43d5 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:02.421023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:02.422050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:02.422327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:02.423754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] PATH_INFO: `/v3/users/abf7636bd87d44c7a7f462ff9ce2f1f7` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:02.426496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf7636bd87d44c7a7f462ff9ce2f1f7)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:02.438848 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:02.670033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf7636bd87d44c7a7f462ff9ce2f1f7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:02.700407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8e39-78f1-491b-bfdb-7a55840205b7 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:02.701015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8e39-78f1-491b-bfdb-7a55840205b7 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:02.701015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae8e39-78f1-491b-bfdb-7a55840205b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:02.718354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf7636bd87d44c7a7f462ff9ce2f1f7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:02.722227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-32ae8e39-78f1-491b-bfdb-7a55840205b7 None None] MFA Rules not processed for user `b9ab8c84c68b4275b2f81b69d8a52826`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:02.723504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-32ae8e39-78f1-491b-bfdb-7a55840205b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:02.785739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf7636bd87d44c7a7f462ff9ce2f1f7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:02.786379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf7636bd87d44c7a7f462ff9ce2f1f7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:02.788284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9dfe9f4c-19a9-4ce3-a61a-3cc2aea29d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf7636bd87d44c7a7f462ff9ce2f1f7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:02.801567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:02.819394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1110/2249] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:02 2022] DELETE /identity/v3/users/abf7636bd87d44c7a7f462ff9ce2f1f7 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:02.825799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1140/2250] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:54:02.828198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c2774-9d0a-4a2e-bcb7-8698cff569e9 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:02.828513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c2774-9d0a-4a2e-bcb7-8698cff569e9 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:02.828801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c2774-9d0a-4a2e-bcb7-8698cff569e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:02.874354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8b2c2774-9d0a-4a2e-bcb7-8698cff569e9 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:02.875942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8b2c2774-9d0a-4a2e-bcb7-8698cff569e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:02.981420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1111/2251] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:54:02.991474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae8e39-78f1-491b-bfdb-7a55840205b7 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:02.993869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-32ae8e39-78f1-491b-bfdb-7a55840205b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:03.071813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:03.222840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae8e39-78f1-491b-bfdb-7a55840205b7 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:03.314372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa793a61-a5f5-493d-98f0-b6ffebb9aaea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:03.315978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793a61-a5f5-493d-98f0-b6ffebb9aaea service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:03.316551 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793a61-a5f5-493d-98f0-b6ffebb9aaea service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:03.317058 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793a61-a5f5-493d-98f0-b6ffebb9aaea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:03.332649 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa793a61-a5f5-493d-98f0-b6ffebb9aaea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:03.335066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa793a61-a5f5-493d-98f0-b6ffebb9aaea service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:03.354296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1141/2252] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:04.090931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c2774-9d0a-4a2e-bcb7-8698cff569e9 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:04.092486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8b2c2774-9d0a-4a2e-bcb7-8698cff569e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:04.119885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c2774-9d0a-4a2e-bcb7-8698cff569e9 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:04.140687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:04.141622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:04.141911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:04.142192 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] PATH_INFO: `/v3/projects/f61190c709d04d18b46e15d36f7388fe` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:04.144770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61190c709d04d18b46e15d36f7388fe)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:04.146705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:04.377051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61190c709d04d18b46e15d36f7388fe', 'request_id': 'req-69da91e3-3f7d-4163-a57a-cb79eb6c162e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:04.393930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61190c709d04d18b46e15d36f7388fe', 'request_id': 'req-69da91e3-3f7d-4163-a57a-cb79eb6c162e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:04.402648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61190c709d04d18b46e15d36f7388fe', 'request_id': 'req-69da91e3-3f7d-4163-a57a-cb79eb6c162e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:04.517188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7bb45-c6a5-4724-8ab3-3477e0d3a632 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:04.518293 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7bb45-c6a5-4724-8ab3-3477e0d3a632 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:04.518799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7bb45-c6a5-4724-8ab3-3477e0d3a632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:04.530560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] The token cache is being invalidate because project f61190c709d04d18b46e15d36f7388fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:04.530870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:04.532390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-69da91e3-3f7d-4163-a57a-cb79eb6c162e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:04.537564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1112/2253] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:04 2022] DELETE /identity/v3/projects/f61190c709d04d18b46e15d36f7388fe => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:04.541904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840ec04-9269-455f-9fcd-829e4000d1be None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:04.542688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840ec04-9269-455f-9fcd-829e4000d1be None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:04.543130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840ec04-9269-455f-9fcd-829e4000d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:04.545079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1ef7bb45-c6a5-4724-8ab3-3477e0d3a632 None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:04.546702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1ef7bb45-c6a5-4724-8ab3-3477e0d3a632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:04.635716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d840ec04-9269-455f-9fcd-829e4000d1be None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:04.641338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d840ec04-9269-455f-9fcd-829e4000d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:04.641534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1142/2254] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:54:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:04.661205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7bb45-c6a5-4724-8ab3-3477e0d3a632 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:04.663184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1ef7bb45-c6a5-4724-8ab3-3477e0d3a632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:04.783071 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:04.785399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1113/2255] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:04.793805 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ddc88-91c5-4d2f-b259-c44598868f75 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:04.794445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ddc88-91c5-4d2f-b259-c44598868f75 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:04.794872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ddc88-91c5-4d2f-b259-c44598868f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:04.842907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f79ddc88-91c5-4d2f-b259-c44598868f75 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:04.848330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f79ddc88-91c5-4d2f-b259-c44598868f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:04.854060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7bb45-c6a5-4724-8ab3-3477e0d3a632 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:04.860351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f158d8e-0b79-4507-bb37-2280d705cd2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:04.861659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f158d8e-0b79-4507-bb37-2280d705cd2e service swift] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:04.862064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f158d8e-0b79-4507-bb37-2280d705cd2e service swift] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:04.862418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f158d8e-0b79-4507-bb37-2280d705cd2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:04.869216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1114/2256] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:04.873445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ddc88-91c5-4d2f-b259-c44598868f75 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:04.873925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f158d8e-0b79-4507-bb37-2280d705cd2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:04.875766 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f158d8e-0b79-4507-bb37-2280d705cd2e service swift] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:04.885827 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1143/2257] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:54:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:04.895262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ddc88-91c5-4d2f-b259-c44598868f75 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:04.901080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98f29-78b0-4e96-aedb-0bbcbf33c9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:04.901671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98f29-78b0-4e96-aedb-0bbcbf33c9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:04.901956 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98f29-78b0-4e96-aedb-0bbcbf33c9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:04.902174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98f29-78b0-4e96-aedb-0bbcbf33c9f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:04.902904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98f29-78b0-4e96-aedb-0bbcbf33c9f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:54:04.903214 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98f29-78b0-4e96-aedb-0bbcbf33c9f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:04.904913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98f29-78b0-4e96-aedb-0bbcbf33c9f9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:04.919403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1115/2258] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:54:04.923637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f158d8e-0b79-4507-bb37-2280d705cd2e service swift] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:04.936486 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f158d8e-0b79-4507-bb37-2280d705cd2e service swift] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:04.941384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81a7af-164b-4f01-8177-656952423109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:04.942046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81a7af-164b-4f01-8177-656952423109 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:04.942330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81a7af-164b-4f01-8177-656952423109 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:04.942608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81a7af-164b-4f01-8177-656952423109 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:04.943305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81a7af-164b-4f01-8177-656952423109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:04.946326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81a7af-164b-4f01-8177-656952423109 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:05.104715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1144/2259] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:54:04 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:05.108907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98f29-78b0-4e96-aedb-0bbcbf33c9f9 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:05.122060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98f29-78b0-4e96-aedb-0bbcbf33c9f9 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:05.200350 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f059f-0b80-4510-bead-f99328ee28ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:05.201310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f059f-0b80-4510-bead-f99328ee28ab admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:05.201598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f059f-0b80-4510-bead-f99328ee28ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:05.201879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f059f-0b80-4510-bead-f99328ee28ab admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:05.202565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f059f-0b80-4510-bead-f99328ee28ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:05.204682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f059f-0b80-4510-bead-f99328ee28ab admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:05.296154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1116/2260] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:54:05 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:05.300312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81a7af-164b-4f01-8177-656952423109 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:05.316565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81a7af-164b-4f01-8177-656952423109 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:05.323736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ebd96-6019-4c9a-8ace-3c624471bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:05.324503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ebd96-6019-4c9a-8ace-3c624471bad7 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:05.325285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ebd96-6019-4c9a-8ace-3c624471bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:05.325684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ebd96-6019-4c9a-8ace-3c624471bad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:05.327858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ebd96-6019-4c9a-8ace-3c624471bad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:05.329852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ebd96-6019-4c9a-8ace-3c624471bad7 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:05.345455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1145/2261] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:05.347174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f059f-0b80-4510-bead-f99328ee28ab admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:05.359968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f059f-0b80-4510-bead-f99328ee28ab admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:05.365194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e722b-bfde-406c-8211-24cdcdbbdb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:05.366153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e722b-bfde-406c-8211-24cdcdbbdb5e admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:05.366609 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e722b-bfde-406c-8211-24cdcdbbdb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:05.367156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e722b-bfde-406c-8211-24cdcdbbdb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:05.369010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e722b-bfde-406c-8211-24cdcdbbdb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:05.370929 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e722b-bfde-406c-8211-24cdcdbbdb5e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:05.389203 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1117/2262] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:05.389786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ebd96-6019-4c9a-8ace-3c624471bad7 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:05.400707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ebd96-6019-4c9a-8ace-3c624471bad7 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:05.410794 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12800ca-cce5-4db5-9838-03f2b1627f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:05.412392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12800ca-cce5-4db5-9838-03f2b1627f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:05.412680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12800ca-cce5-4db5-9838-03f2b1627f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:05.412963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12800ca-cce5-4db5-9838-03f2b1627f90 admin admin] PATH_INFO: `/v3/projects/be916fd22efe402ea3336906b138dc4a/users/dc8ed475c95846da88802f33bdde1cab/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:05.445219 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12800ca-cce5-4db5-9838-03f2b1627f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be916fd22efe402ea3336906b138dc4a, user_id=dc8ed475c95846da88802f33bdde1cab, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:05.448603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12800ca-cce5-4db5-9838-03f2b1627f90 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:05.546586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:05.591500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1146/2263] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:05 2022] PUT /identity/v3/projects/be916fd22efe402ea3336906b138dc4a/users/dc8ed475c95846da88802f33bdde1cab/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:54:05.594299 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc597f-22f8-4f1f-8cdb-d4cbcaad5c97 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:05.594594 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc597f-22f8-4f1f-8cdb-d4cbcaad5c97 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:05.594873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc597f-22f8-4f1f-8cdb-d4cbcaad5c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:05.636691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c9cc597f-22f8-4f1f-8cdb-d4cbcaad5c97 None None] MFA Rules not processed for user `dc8ed475c95846da88802f33bdde1cab`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:05.638063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c9cc597f-22f8-4f1f-8cdb-d4cbcaad5c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:05.738017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1118/2264] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:05.748758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12800ca-cce5-4db5-9838-03f2b1627f90 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:05.750943 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b12800ca-cce5-4db5-9838-03f2b1627f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:05.837972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12800ca-cce5-4db5-9838-03f2b1627f90 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:05.843806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897c89-5559-4a73-a7ae-adef74521bc1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd039be6500e74ae3a6f30821c5c19a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:05.844470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897c89-5559-4a73-a7ae-adef74521bc1 service glance] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:05.844759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897c89-5559-4a73-a7ae-adef74521bc1 service glance] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:05.845031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897c89-5559-4a73-a7ae-adef74521bc1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:05.862825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16897c89-5559-4a73-a7ae-adef74521bc1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:05.864398 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16897c89-5559-4a73-a7ae-adef74521bc1 service glance] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:05.879488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1147/2265] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:15.870815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=59,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:16.992333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:20.240940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82c231-c743-4588-8864-db4c5910236d None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:20.242267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82c231-c743-4588-8864-db4c5910236d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:20.242703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82c231-c743-4588-8864-db4c5910236d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:20.284932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-1e82c231-c743-4588-8864-db4c5910236d None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:20.286355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1e82c231-c743-4588-8864-db4c5910236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:20.384337 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1119/2266] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:54:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:20.393924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897c89-5559-4a73-a7ae-adef74521bc1 service glance] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:20.541324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897c89-5559-4a73-a7ae-adef74521bc1 service glance] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:20.548418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b82a56-5712-4340-9165-282c70c9f3ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:20.550489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b82a56-5712-4340-9165-282c70c9f3ea service swift] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:20.550489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b82a56-5712-4340-9165-282c70c9f3ea service swift] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:20.550489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b82a56-5712-4340-9165-282c70c9f3ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:20.578675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b82a56-5712-4340-9165-282c70c9f3ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:20.580188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b82a56-5712-4340-9165-282c70c9f3ea service swift] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:20.591357 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1148/2267] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:54:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:30.367500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=29 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:30.586474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=35 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:46.828576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb1075-cd45-4d43-a493-06a73c83bff2 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:46.829186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb1075-cd45-4d43-a493-06a73c83bff2 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:46.829625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb1075-cd45-4d43-a493-06a73c83bff2 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:46.831945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1120/2268] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:54:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:54:46.839182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43e01-f068-4e82-8466-d0e963e428cb None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:46.839773 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43e01-f068-4e82-8466-d0e963e428cb None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:46.840011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43e01-f068-4e82-8466-d0e963e428cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:46.893226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb1075-cd45-4d43-a493-06a73c83bff2 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:46.921118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b3b43e01-f068-4e82-8466-d0e963e428cb None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:46.922458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b3b43e01-f068-4e82-8466-d0e963e428cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:47.003694 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb1075-cd45-4d43-a493-06a73c83bff2 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:47.009391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:47.010784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.011224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.011939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] PATH_INFO: `/v3/users/dc8ed475c95846da88802f33bdde1cab` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.015187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8ed475c95846da88802f33bdde1cab)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:47.015701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:47.051515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1149/2269] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:54:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:47.056917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43e01-f068-4e82-8466-d0e963e428cb None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:47.058883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b3b43e01-f068-4e82-8466-d0e963e428cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:47.096478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43e01-f068-4e82-8466-d0e963e428cb None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:47.104771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743559a0-138c-47d7-9ce6-9129f5277fd4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd039be6500e74ae3a6f30821c5c19a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:47.104771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743559a0-138c-47d7-9ce6-9129f5277fd4 service glance] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.104771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743559a0-138c-47d7-9ce6-9129f5277fd4 service glance] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.105092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743559a0-138c-47d7-9ce6-9129f5277fd4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.125108 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743559a0-138c-47d7-9ce6-9129f5277fd4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:47.126792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743559a0-138c-47d7-9ce6-9129f5277fd4 service glance] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:47.156781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1150/2270] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:54:47.260568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8ed475c95846da88802f33bdde1cab'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:47.276845 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8ed475c95846da88802f33bdde1cab'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:47.368566 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8ed475c95846da88802f33bdde1cab'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:47.369208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8ed475c95846da88802f33bdde1cab'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:47.369821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f253d9b-e163-47c9-9125-daf550eb0ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8ed475c95846da88802f33bdde1cab'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:47.400700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e502e-6c44-457c-86e2-fa44ccea083d None None] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.401023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e502e-6c44-457c-86e2-fa44ccea083d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.401330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e502e-6c44-457c-86e2-fa44ccea083d None None] PATH_INFO: `/` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.403104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1151/2271] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:54:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 08:54:47.407725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1121/2272] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:46 2022] DELETE /identity/v3/users/dc8ed475c95846da88802f33bdde1cab => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:54:47.412528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d7f52-8a17-4348-ae7b-24d2ad625104 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.415944 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d7f52-8a17-4348-ae7b-24d2ad625104 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.415944 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d7f52-8a17-4348-ae7b-24d2ad625104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.428190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e3497-fa50-4346-ad34-5c4d93f02038 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.428475 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e3497-fa50-4346-ad34-5c4d93f02038 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.428788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e3497-fa50-4346-ad34-5c4d93f02038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.446877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1e9d7f52-8a17-4348-ae7b-24d2ad625104 None None] MFA Rules not processed for user `024e0e53cfdb42e88dfdfde7a79e8c75`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:47.448469 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1e9d7f52-8a17-4348-ae7b-24d2ad625104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:47.460763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8d4e3497-fa50-4346-ad34-5c4d93f02038 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:47.462884 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8d4e3497-fa50-4346-ad34-5c4d93f02038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:47.555071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1122/2273] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:47.555399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1152/2274] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:54:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:47.561866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e3497-fa50-4346-ad34-5c4d93f02038 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:47.564820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8d4e3497-fa50-4346-ad34-5c4d93f02038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:47.570454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d7f52-8a17-4348-ae7b-24d2ad625104 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:47.581129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e3497-fa50-4346-ad34-5c4d93f02038 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:47.582059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d7f52-8a17-4348-ae7b-24d2ad625104 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:47.586280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cb099-34bc-4132-b065-d96d43fd7fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:47.587089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8336cd-f3a3-4bbe-8f5d-78d65ebd0e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:47.587309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb099-34bc-4132-b065-d96d43fd7fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.587723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb099-34bc-4132-b065-d96d43fd7fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.587945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8336cd-f3a3-4bbe-8f5d-78d65ebd0e0c service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.588185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb099-34bc-4132-b065-d96d43fd7fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.588298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8336cd-f3a3-4bbe-8f5d-78d65ebd0e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.589114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8336cd-f3a3-4bbe-8f5d-78d65ebd0e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.604925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8336cd-f3a3-4bbe-8f5d-78d65ebd0e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:47.606384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8336cd-f3a3-4bbe-8f5d-78d65ebd0e0c service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:47.613059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cb099-34bc-4132-b065-d96d43fd7fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:47.632267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cb099-34bc-4132-b065-d96d43fd7fb9 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:47.645399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1123/2275] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:47.647202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1153/2276] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:47.844017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43439bc-2629-4b73-ad65-d0958076adc6 None None] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.844994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43439bc-2629-4b73-ad65-d0958076adc6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.845288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43439bc-2629-4b73-ad65-d0958076adc6 None None] PATH_INFO: `/` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.847547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1124/2277] 10.222.0.78 () {54 vars in 921 bytes} [Fri Jun 17 08:54:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 08:54:47.855210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bae23-ec0f-47c5-b9e2-b7a21623cd15 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:47.856970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bae23-ec0f-47c5-b9e2-b7a21623cd15 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:47.857394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bae23-ec0f-47c5-b9e2-b7a21623cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:47.895980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-af3bae23-ec0f-47c5-b9e2-b7a21623cd15 None None] MFA Rules not processed for user `6aa3618089794b938018ff2666afebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:47.897400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-af3bae23-ec0f-47c5-b9e2-b7a21623cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:47.908457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:47.969360 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1154/2278] 10.222.0.78 () {58 vars in 1018 bytes} [Fri Jun 17 08:54:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:47.981152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43439bc-2629-4b73-ad65-d0958076adc6 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:47.993409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43439bc-2629-4b73-ad65-d0958076adc6 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:48.001503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bd4dd-90bb-49a2-8aa2-74ad3a77df00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:48.002622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd4dd-90bb-49a2-8aa2-74ad3a77df00 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:48.002915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd4dd-90bb-49a2-8aa2-74ad3a77df00 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:48.003201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bd4dd-90bb-49a2-8aa2-74ad3a77df00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:48.037920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bae23-ec0f-47c5-b9e2-b7a21623cd15 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:48.040722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-af3bae23-ec0f-47c5-b9e2-b7a21623cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:48.051339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:48.060877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bd4dd-90bb-49a2-8aa2-74ad3a77df00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:48.062818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bd4dd-90bb-49a2-8aa2-74ad3a77df00 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:48.092335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1125/2279] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:48.180397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bae23-ec0f-47c5-b9e2-b7a21623cd15 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:48.186629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657197b7-ce83-4a4d-ba56-020c1b12e81b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:48.187297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657197b7-ce83-4a4d-ba56-020c1b12e81b service placement] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:48.187669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657197b7-ce83-4a4d-ba56-020c1b12e81b service placement] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:48.187955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657197b7-ce83-4a4d-ba56-020c1b12e81b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:48.189839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-657197b7-ce83-4a4d-ba56-020c1b12e81b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:48.203395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657197b7-ce83-4a4d-ba56-020c1b12e81b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:48.206984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657197b7-ce83-4a4d-ba56-020c1b12e81b service placement] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:48.217664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1155/2280] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:49.149870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50b587-a562-4670-ae20-e88ce3820f60 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.150444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50b587-a562-4670-ae20-e88ce3820f60 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.150444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50b587-a562-4670-ae20-e88ce3820f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.209325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ad50b587-a562-4670-ae20-e88ce3820f60 None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:49.210633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ad50b587-a562-4670-ae20-e88ce3820f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:49.216131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657197b7-ce83-4a4d-ba56-020c1b12e81b service placement] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:49.218277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-657197b7-ce83-4a4d-ba56-020c1b12e81b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:49.238167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657197b7-ce83-4a4d-ba56-020c1b12e81b service placement] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:49.246456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:49.247980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.248449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.248947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] PATH_INFO: `/v3/projects/be916fd22efe402ea3336906b138dc4a` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.250435 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be916fd22efe402ea3336906b138dc4a)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:49.253838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:49.302875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1126/2281] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:49.329890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50b587-a562-4670-ae20-e88ce3820f60 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:49.331290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ad50b587-a562-4670-ae20-e88ce3820f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:49.392375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be916fd22efe402ea3336906b138dc4a', 'request_id': 'req-96358359-8919-41be-bd97-a141815970a4'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:49.400588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be916fd22efe402ea3336906b138dc4a', 'request_id': 'req-96358359-8919-41be-bd97-a141815970a4'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:49.409562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be916fd22efe402ea3336906b138dc4a', 'request_id': 'req-96358359-8919-41be-bd97-a141815970a4'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:49.466764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50b587-a562-4670-ae20-e88ce3820f60 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:49.496730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:49.514263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] The token cache is being invalidate because project be916fd22efe402ea3336906b138dc4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:49.514849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:49.515839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96358359-8919-41be-bd97-a141815970a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:49.523154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1156/2282] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:49 2022] DELETE /identity/v3/projects/be916fd22efe402ea3336906b138dc4a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:54:49.536665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32494274-ace8-4b63-b803-89a9e22a02a1 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.541951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32494274-ace8-4b63-b803-89a9e22a02a1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.542366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32494274-ace8-4b63-b803-89a9e22a02a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.552895 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:49.589715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b97a63-5a16-47e7-a4ff-a232f28845b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:49.590675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97a63-5a16-47e7-a4ff-a232f28845b4 service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.591093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97a63-5a16-47e7-a4ff-a232f28845b4 service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.592220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97a63-5a16-47e7-a4ff-a232f28845b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.595501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-51b97a63-5a16-47e7-a4ff-a232f28845b4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:49.622058 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-32494274-ace8-4b63-b803-89a9e22a02a1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:49.623052 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-32494274-ace8-4b63-b803-89a9e22a02a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:49.711030 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b97a63-5a16-47e7-a4ff-a232f28845b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:49.714641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b97a63-5a16-47e7-a4ff-a232f28845b4 service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:49.737179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1127/2283] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:54:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 08:54:49.780481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1157/2284] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:49.787885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeaf99-fde8-4a86-a001-322b7fca8a2f None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.788386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeaf99-fde8-4a86-a001-322b7fca8a2f None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.788826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeaf99-fde8-4a86-a001-322b7fca8a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.829197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-dcfeaf99-fde8-4a86-a001-322b7fca8a2f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:49.832654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-dcfeaf99-fde8-4a86-a001-322b7fca8a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:49.861062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1128/2285] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:49.864625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32494274-ace8-4b63-b803-89a9e22a02a1 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:49.883569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32494274-ace8-4b63-b803-89a9e22a02a1 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:49.893480 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c16a0-a414-4e7e-9274-0f338b999d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:49.894314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c16a0-a414-4e7e-9274-0f338b999d33 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.894853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c16a0-a414-4e7e-9274-0f338b999d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.895245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c16a0-a414-4e7e-9274-0f338b999d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.896136 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c16a0-a414-4e7e-9274-0f338b999d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:54:49.896544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c16a0-a414-4e7e-9274-0f338b999d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:49.900470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c16a0-a414-4e7e-9274-0f338b999d33 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:49.920438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1158/2286] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:54:49.921904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfeaf99-fde8-4a86-a001-322b7fca8a2f None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:49.932834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfeaf99-fde8-4a86-a001-322b7fca8a2f None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:49.939000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5766b-db66-43fd-94e7-f321e6ac38c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:49.939826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5766b-db66-43fd-94e7-f321e6ac38c5 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:49.940180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5766b-db66-43fd-94e7-f321e6ac38c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:49.940513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5766b-db66-43fd-94e7-f321e6ac38c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:49.941320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5766b-db66-43fd-94e7-f321e6ac38c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:49.943739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5766b-db66-43fd-94e7-f321e6ac38c5 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:50.071000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1129/2287] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:54:49 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:50.075507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c16a0-a414-4e7e-9274-0f338b999d33 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:50.094182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c16a0-a414-4e7e-9274-0f338b999d33 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:50.173828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9873f2-c976-49da-9cc7-134991c634cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:50.174516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9873f2-c976-49da-9cc7-134991c634cb admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:50.174808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9873f2-c976-49da-9cc7-134991c634cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:50.175148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9873f2-c976-49da-9cc7-134991c634cb admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:50.176057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9873f2-c976-49da-9cc7-134991c634cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:50.178254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9873f2-c976-49da-9cc7-134991c634cb admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:50.299728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1159/2288] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:54:50 2022] POST /identity/v3/users => generated 282 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:54:50.300273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5766b-db66-43fd-94e7-f321e6ac38c5 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:50.313146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5766b-db66-43fd-94e7-f321e6ac38c5 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:50.324294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dead58-190c-4262-a9c7-d725dce04655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:50.325385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dead58-190c-4262-a9c7-d725dce04655 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:50.325924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dead58-190c-4262-a9c7-d725dce04655 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:50.327276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dead58-190c-4262-a9c7-d725dce04655 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:50.328582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dead58-190c-4262-a9c7-d725dce04655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:50.331466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dead58-190c-4262-a9c7-d725dce04655 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:50.349381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1130/2289] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:50.354239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9873f2-c976-49da-9cc7-134991c634cb admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:50.368864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9873f2-c976-49da-9cc7-134991c634cb admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:50.376122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff971c17-5cdc-4531-a224-a2713c29ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:50.377669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971c17-5cdc-4531-a224-a2713c29ea7d admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:50.377669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971c17-5cdc-4531-a224-a2713c29ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:50.378115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971c17-5cdc-4531-a224-a2713c29ea7d admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:50.379080 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff971c17-5cdc-4531-a224-a2713c29ea7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:50.381002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff971c17-5cdc-4531-a224-a2713c29ea7d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:50.399292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1160/2290] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:54:50.404944 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dead58-190c-4262-a9c7-d725dce04655 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:50.421394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dead58-190c-4262-a9c7-d725dce04655 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:50.427405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d57e-fcac-4d3a-a926-65f323383751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:50.428370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d57e-fcac-4d3a-a926-65f323383751 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:50.441163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d57e-fcac-4d3a-a926-65f323383751 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:50.441163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d57e-fcac-4d3a-a926-65f323383751 admin admin] PATH_INFO: `/v3/projects/68efdab5adda4f5296a64d8e7ae3dd33/users/791d4fc9e2534275a7d2ba080f58b832/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:50.455782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217d57e-fcac-4d3a-a926-65f323383751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68efdab5adda4f5296a64d8e7ae3dd33, user_id=791d4fc9e2534275a7d2ba080f58b832, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:50.465494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217d57e-fcac-4d3a-a926-65f323383751 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:50.583410 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1131/2291] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:54:50 2022] PUT /identity/v3/projects/68efdab5adda4f5296a64d8e7ae3dd33/users/791d4fc9e2534275a7d2ba080f58b832/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:50.595805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b369f3-fa53-4209-8535-014602a553fc None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:50.596109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b369f3-fa53-4209-8535-014602a553fc None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:50.596401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b369f3-fa53-4209-8535-014602a553fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:50.648024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-d7b369f3-fa53-4209-8535-014602a553fc None None] MFA Rules not processed for user `791d4fc9e2534275a7d2ba080f58b832`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:50.650186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d7b369f3-fa53-4209-8535-014602a553fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:50.734264 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:50.753137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1161/2292] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:54:50.768914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d57e-fcac-4d3a-a926-65f323383751 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:50.770849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f217d57e-fcac-4d3a-a926-65f323383751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:50.798553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c433d-9194-4a56-8fe7-f24c0bd3a5fc None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:50.799046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c433d-9194-4a56-8fe7-f24c0bd3a5fc None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:50.799510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c433d-9194-4a56-8fe7-f24c0bd3a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:50.822223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-016c433d-9194-4a56-8fe7-f24c0bd3a5fc None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:50.824001 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-016c433d-9194-4a56-8fe7-f24c0bd3a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:50.909401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d57e-fcac-4d3a-a926-65f323383751 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:50.918888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50ca27-f18d-4b51-a1b9-e7da4e885029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:50.919660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ca27-f18d-4b51-a1b9-e7da4e885029 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:50.920070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ca27-f18d-4b51-a1b9-e7da4e885029 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:50.920225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ca27-f18d-4b51-a1b9-e7da4e885029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:50.940024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50ca27-f18d-4b51-a1b9-e7da4e885029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:50.941697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50ca27-f18d-4b51-a1b9-e7da4e885029 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:50.946060 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1162/2293] 10.222.0.78 () {58 vars in 967 bytes} [Fri Jun 17 08:54:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:54:50.954628 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c433d-9194-4a56-8fe7-f24c0bd3a5fc None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:50.956133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1132/2294] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:54:50.957030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-016c433d-9194-4a56-8fe7-f24c0bd3a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:51.065431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c433d-9194-4a56-8fe7-f24c0bd3a5fc None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:51.073936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ace30-adc1-43c4-8fe9-6869fcf4f212 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:51.075055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ace30-adc1-43c4-8fe9-6869fcf4f212 service swift] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:51.075055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ace30-adc1-43c4-8fe9-6869fcf4f212 service swift] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:51.075312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ace30-adc1-43c4-8fe9-6869fcf4f212 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:51.084876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ace30-adc1-43c4-8fe9-6869fcf4f212 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:51.086502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ace30-adc1-43c4-8fe9-6869fcf4f212 service swift] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:51.097164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1163/2295] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:54:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:52.191893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdeaa-e0aa-448f-b3f2-0d82f4acdb3a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:52.191893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdeaa-e0aa-448f-b3f2-0d82f4acdb3a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:52.191893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdeaa-e0aa-448f-b3f2-0d82f4acdb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:52.209791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-faecdeaa-e0aa-448f-b3f2-0d82f4acdb3a None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:52.211119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-faecdeaa-e0aa-448f-b3f2-0d82f4acdb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:52.218481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1133/2296] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:54:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:52.232221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ace30-adc1-43c4-8fe9-6869fcf4f212 service swift] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:52.244667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ace30-adc1-43c4-8fe9-6869fcf4f212 service swift] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:52.249764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1720977-148e-49f9-a3c6-4a1c26ef1575 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:52.250406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1720977-148e-49f9-a3c6-4a1c26ef1575 service swift] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:52.250694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1720977-148e-49f9-a3c6-4a1c26ef1575 service swift] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:52.250979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1720977-148e-49f9-a3c6-4a1c26ef1575 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:52.260263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1720977-148e-49f9-a3c6-4a1c26ef1575 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:52.261853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1720977-148e-49f9-a3c6-4a1c26ef1575 service swift] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:52.270308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1164/2297] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:54:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 08:54:52.970235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718189-e147-45ed-98d7-368a1f7f3b21 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:52.973445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718189-e147-45ed-98d7-368a1f7f3b21 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:52.973445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718189-e147-45ed-98d7-368a1f7f3b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:52.979706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:52.991719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b1718189-e147-45ed-98d7-368a1f7f3b21 None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:52.992934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b1718189-e147-45ed-98d7-368a1f7f3b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:53.000240 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1134/2298] 10.222.0.78 () {58 vars in 967 bytes} [Fri Jun 17 08:54:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:53.013668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1720977-148e-49f9-a3c6-4a1c26ef1575 service swift] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:53.024935 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1720977-148e-49f9-a3c6-4a1c26ef1575 service swift] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:53.030095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b86db0-cef2-40f2-984b-2afee89459e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:53.030859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b86db0-cef2-40f2-984b-2afee89459e7 service swift] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:53.031053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b86db0-cef2-40f2-984b-2afee89459e7 service swift] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:53.031339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b86db0-cef2-40f2-984b-2afee89459e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:53.040911 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b86db0-cef2-40f2-984b-2afee89459e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:53.042320 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b86db0-cef2-40f2-984b-2afee89459e7 service swift] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:53.051338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1165/2299] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:54:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:54:56.594019 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718189-e147-45ed-98d7-368a1f7f3b21 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:56.595473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b1718189-e147-45ed-98d7-368a1f7f3b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:56.688148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718189-e147-45ed-98d7-368a1f7f3b21 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:56.692995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:56.693885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:56.694195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:56.694474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] PATH_INFO: `/v3/users/8885e2308ed64b52afcb6b6e6b67bffe` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:56.695899 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8885e2308ed64b52afcb6b6e6b67bffe)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:56.697896 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:56.890840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8885e2308ed64b52afcb6b6e6b67bffe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:56.898682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8885e2308ed64b52afcb6b6e6b67bffe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:56.984805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b86db0-cef2-40f2-984b-2afee89459e7 service swift] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:56.988743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8885e2308ed64b52afcb6b6e6b67bffe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:56.988743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8885e2308ed64b52afcb6b6e6b67bffe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:56.988940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c9b86db0-cef2-40f2-984b-2afee89459e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:56.989031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-be87088d-4988-4567-ba14-521932b2d68d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8885e2308ed64b52afcb6b6e6b67bffe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:57.015025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1135/2300] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:54:56 2022] DELETE /identity/v3/users/8885e2308ed64b52afcb6b6e6b67bffe => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:57.019582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc997e-524c-4553-963d-ba13851765d7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:57.019875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc997e-524c-4553-963d-ba13851765d7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:57.020154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc997e-524c-4553-963d-ba13851765d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:57.039217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-0dcc997e-524c-4553-963d-ba13851765d7 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:57.040475 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0dcc997e-524c-4553-963d-ba13851765d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:57.053938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b86db0-cef2-40f2-984b-2afee89459e7 service swift] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:57.071003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:57.104610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1136/2301] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:54:57.111556 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b6bd6-e5ed-403d-a5aa-bb0cb82d8226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:57.112238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6bd6-e5ed-403d-a5aa-bb0cb82d8226 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:57.112517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6bd6-e5ed-403d-a5aa-bb0cb82d8226 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:57.112794 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6bd6-e5ed-403d-a5aa-bb0cb82d8226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:57.114736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc997e-524c-4553-963d-ba13851765d7 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:57.114854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-245b6bd6-e5ed-403d-a5aa-bb0cb82d8226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:57.115961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0dcc997e-524c-4553-963d-ba13851765d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:57.128516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc997e-524c-4553-963d-ba13851765d7 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:57.132755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75ca3a-2c38-466c-9103-f87025743905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:57.133708 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75ca3a-2c38-466c-9103-f87025743905 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:57.133828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75ca3a-2c38-466c-9103-f87025743905 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:57.134021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75ca3a-2c38-466c-9103-f87025743905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:57.143744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75ca3a-2c38-466c-9103-f87025743905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:57.145191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75ca3a-2c38-466c-9103-f87025743905 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:57.156933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1137/2302] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:54:57.185359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b6bd6-e5ed-403d-a5aa-bb0cb82d8226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:57.186818 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b6bd6-e5ed-403d-a5aa-bb0cb82d8226 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:57.198229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1166/2303] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:54:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:54:57.450815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75ca3a-2c38-466c-9103-f87025743905 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:57.452413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5b75ca3a-2c38-466c-9103-f87025743905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:57.464705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:54:57.479425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75ca3a-2c38-466c-9103-f87025743905 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:57.487205 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:57.488352 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:57.488723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:57.489006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] PATH_INFO: `/v3/projects/f5809f2e310d4768acbf28fb54280f35` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:57.490749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5809f2e310d4768acbf28fb54280f35)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:54:57.493538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:54:57.622036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5809f2e310d4768acbf28fb54280f35', 'request_id': 'req-1b0a0d16-729c-4335-8419-8cb31fdc837d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:57.631109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5809f2e310d4768acbf28fb54280f35', 'request_id': 'req-1b0a0d16-729c-4335-8419-8cb31fdc837d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:57.638945 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5809f2e310d4768acbf28fb54280f35', 'request_id': 'req-1b0a0d16-729c-4335-8419-8cb31fdc837d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:57.695220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] The token cache is being invalidate because project f5809f2e310d4768acbf28fb54280f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:54:57.695766 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:57.696487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:54:57.698546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1138/2304] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:54:57 2022] DELETE /identity/v3/projects/f5809f2e310d4768acbf28fb54280f35 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:54:59.732727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab148fb-8889-4356-ad29-aa06664a7ef5 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:59.739302 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab148fb-8889-4356-ad29-aa06664a7ef5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:59.739302 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab148fb-8889-4356-ad29-aa06664a7ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:54:59.760130 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-7ab148fb-8889-4356-ad29-aa06664a7ef5 None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:54:59.762062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7ab148fb-8889-4356-ad29-aa06664a7ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:59.852001 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1167/2305] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:54:59.864927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:54:59.867201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:54:59.982980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a0d16-729c-4335-8419-8cb31fdc837d admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:54:59.990904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ed059-5365-42db-9ac9-e20e727b1eb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:54:59.993179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ed059-5365-42db-9ac9-e20e727b1eb6 service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:54:59.994081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ed059-5365-42db-9ac9-e20e727b1eb6 service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:54:59.994749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ed059-5365-42db-9ac9-e20e727b1eb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:00.015798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ed059-5365-42db-9ac9-e20e727b1eb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:00.015798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ed059-5365-42db-9ac9-e20e727b1eb6 service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:00.028253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1139/2306] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:54:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:55:00.737861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b684a2-33bc-4a53-b313-eb24425cb9fb None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:00.739154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b684a2-33bc-4a53-b313-eb24425cb9fb None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:00.739644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b684a2-33bc-4a53-b313-eb24425cb9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:00.766193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-56b684a2-33bc-4a53-b313-eb24425cb9fb None None] MFA Rules not processed for user `f571731515754890874b862a1407ebc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:00.769149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-56b684a2-33bc-4a53-b313-eb24425cb9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:00.878677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1168/2307] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:55:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:55:10.024139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:10.859375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:17.858158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ed059-5365-42db-9ac9-e20e727b1eb6 service swift] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:17.860057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-689ed059-5365-42db-9ac9-e20e727b1eb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:17.935503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ed059-5365-42db-9ac9-e20e727b1eb6 service swift] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:17.939533 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e74e2-8009-425f-a9af-b5e38e40d983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:17.940210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e74e2-8009-425f-a9af-b5e38e40d983 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:17.940524 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e74e2-8009-425f-a9af-b5e38e40d983 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:17.940798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e74e2-8009-425f-a9af-b5e38e40d983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:17.942770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e57e74e2-8009-425f-a9af-b5e38e40d983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:18.014509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e74e2-8009-425f-a9af-b5e38e40d983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:18.016059 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e74e2-8009-425f-a9af-b5e38e40d983 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:18.028199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1140/2308] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:55:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:55:23.691845 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e971c-9d8f-4215-b991-6fbcf59def33 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:23.692460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e971c-9d8f-4215-b991-6fbcf59def33 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:23.692460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e971c-9d8f-4215-b991-6fbcf59def33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:23.716541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-640e971c-9d8f-4215-b991-6fbcf59def33 None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:23.717762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-640e971c-9d8f-4215-b991-6fbcf59def33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:23.727491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1169/2309] 10.222.0.78 () {58 vars in 967 bytes} [Fri Jun 17 08:55:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:23.742650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e74e2-8009-425f-a9af-b5e38e40d983 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:23.754295 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e74e2-8009-425f-a9af-b5e38e40d983 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:23.760172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429a963-8842-4f2f-bec9-b3e0a9248445 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:23.761507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429a963-8842-4f2f-bec9-b3e0a9248445 service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:23.761790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429a963-8842-4f2f-bec9-b3e0a9248445 service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:23.762062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429a963-8842-4f2f-bec9-b3e0a9248445 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:23.774659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429a963-8842-4f2f-bec9-b3e0a9248445 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:23.774659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429a963-8842-4f2f-bec9-b3e0a9248445 service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:23.781547 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1141/2310] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:55:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:55:33.197639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509fc38-adce-4ba1-b491-15e3fdc390c7 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:33.198500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509fc38-adce-4ba1-b491-15e3fdc390c7 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:33.198500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509fc38-adce-4ba1-b491-15e3fdc390c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:33.216047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-9509fc38-adce-4ba1-b491-15e3fdc390c7 None None] MFA Rules not processed for user `5e4214dbd10d491eb6afa50321edca88`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:33.217173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9509fc38-adce-4ba1-b491-15e3fdc390c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:33.274275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1170/2311] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:55:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:33.777743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=56 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:43.266869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=28 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:45.805158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429a963-8842-4f2f-bec9-b3e0a9248445 service swift] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:45.806683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5429a963-8842-4f2f-bec9-b3e0a9248445 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:45.874307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429a963-8842-4f2f-bec9-b3e0a9248445 service swift] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:45.879081 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:45.881151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:45.881151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:45.881151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] PATH_INFO: `/v3/users/791d4fc9e2534275a7d2ba080f58b832` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:45.882168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=791d4fc9e2534275a7d2ba080f58b832)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:45.884217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:46.108456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791d4fc9e2534275a7d2ba080f58b832'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:46.115949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791d4fc9e2534275a7d2ba080f58b832'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:46.167172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791d4fc9e2534275a7d2ba080f58b832'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:46.167802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791d4fc9e2534275a7d2ba080f58b832'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:46.168402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791d4fc9e2534275a7d2ba080f58b832'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:46.189620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1142/2312] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:55:45 2022] DELETE /identity/v3/users/791d4fc9e2534275a7d2ba080f58b832 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:55:46.191177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541287e-3497-456d-adea-61cdc73e73e4 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:46.191630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541287e-3497-456d-adea-61cdc73e73e4 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:46.191755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541287e-3497-456d-adea-61cdc73e73e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:46.210892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-7541287e-3497-456d-adea-61cdc73e73e4 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:46.212113 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7541287e-3497-456d-adea-61cdc73e73e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:46.272389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1171/2313] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:46.282266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:46.283792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:46.341857 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06580a5-851d-43be-b6c1-b33b9d5c6ed4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:46.345541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd95151-16de-4b5d-9c83-40d5b9441ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:46.346186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95151-16de-4b5d-9c83-40d5b9441ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:46.346470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95151-16de-4b5d-9c83-40d5b9441ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:46.346750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd95151-16de-4b5d-9c83-40d5b9441ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:46.357604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd95151-16de-4b5d-9c83-40d5b9441ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:46.361529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd95151-16de-4b5d-9c83-40d5b9441ae1 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:46.369242 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1143/2314] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:55:46.752828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541287e-3497-456d-adea-61cdc73e73e4 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:46.754253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7541287e-3497-456d-adea-61cdc73e73e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:46.777153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541287e-3497-456d-adea-61cdc73e73e4 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:46.783326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:46.784252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:46.784543 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:46.784826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] PATH_INFO: `/v3/projects/68efdab5adda4f5296a64d8e7ae3dd33` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:46.786056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68efdab5adda4f5296a64d8e7ae3dd33)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:46.788723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:46.888634 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68efdab5adda4f5296a64d8e7ae3dd33', 'request_id': 'req-abcf1457-3900-4e31-9477-086e8028aa27'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:46.894769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68efdab5adda4f5296a64d8e7ae3dd33', 'request_id': 'req-abcf1457-3900-4e31-9477-086e8028aa27'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:46.900300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68efdab5adda4f5296a64d8e7ae3dd33', 'request_id': 'req-abcf1457-3900-4e31-9477-086e8028aa27'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:46.961800 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] The token cache is being invalidate because project 68efdab5adda4f5296a64d8e7ae3dd33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:55:46.962084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:46.962731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-abcf1457-3900-4e31-9477-086e8028aa27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:46.964317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1172/2315] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:55:46 2022] DELETE /identity/v3/projects/68efdab5adda4f5296a64d8e7ae3dd33 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:55:46.969238 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68a35-0203-4d39-a3ff-0861dddb9d02 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:46.969720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68a35-0203-4d39-a3ff-0861dddb9d02 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:46.969847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68a35-0203-4d39-a3ff-0861dddb9d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:46.990208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-41d68a35-0203-4d39-a3ff-0861dddb9d02 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:46.991825 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-41d68a35-0203-4d39-a3ff-0861dddb9d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:47.009709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:47.052526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1144/2316] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:47.060570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bbf2f-b9cf-48ff-b5dc-db59820ee1e6 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:47.060858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bbf2f-b9cf-48ff-b5dc-db59820ee1e6 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:47.061134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bbf2f-b9cf-48ff-b5dc-db59820ee1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:47.080066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-222bbf2f-b9cf-48ff-b5dc-db59820ee1e6 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:47.081308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-222bbf2f-b9cf-48ff-b5dc-db59820ee1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:47.089376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1173/2317] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:47.093719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d68a35-0203-4d39-a3ff-0861dddb9d02 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:47.103750 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d68a35-0203-4d39-a3ff-0861dddb9d02 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:47.108276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9925dc-9be2-4634-808e-c8c37832c25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:47.108979 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9925dc-9be2-4634-808e-c8c37832c25f admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:47.109478 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9925dc-9be2-4634-808e-c8c37832c25f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:47.109773 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9925dc-9be2-4634-808e-c8c37832c25f admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:47.110774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9925dc-9be2-4634-808e-c8c37832c25f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:55:47.111473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9925dc-9be2-4634-808e-c8c37832c25f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:47.113110 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9925dc-9be2-4634-808e-c8c37832c25f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:47.125117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1145/2318] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:55:47.129287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bbf2f-b9cf-48ff-b5dc-db59820ee1e6 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:47.139168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bbf2f-b9cf-48ff-b5dc-db59820ee1e6 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:47.143846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ed071-5cc7-41e7-ba30-fcdc8acaedd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:47.144490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed071-5cc7-41e7-ba30-fcdc8acaedd8 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:47.144771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed071-5cc7-41e7-ba30-fcdc8acaedd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:47.145045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed071-5cc7-41e7-ba30-fcdc8acaedd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:47.145764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ed071-5cc7-41e7-ba30-fcdc8acaedd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:47.147737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ed071-5cc7-41e7-ba30-fcdc8acaedd8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:47.214709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1174/2319] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:55:47 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:55:47.218615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9925dc-9be2-4634-808e-c8c37832c25f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:47.229272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9925dc-9be2-4634-808e-c8c37832c25f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:47.287243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7425c-51ea-4ce1-afdd-71c3b96a7f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:47.288186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7425c-51ea-4ce1-afdd-71c3b96a7f7f admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:47.288471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7425c-51ea-4ce1-afdd-71c3b96a7f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:47.288755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7425c-51ea-4ce1-afdd-71c3b96a7f7f admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:47.289460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7425c-51ea-4ce1-afdd-71c3b96a7f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:47.291444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7425c-51ea-4ce1-afdd-71c3b96a7f7f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:47.362138 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1146/2320] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:55:47 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:55:47.367201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ed071-5cc7-41e7-ba30-fcdc8acaedd8 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:47.377674 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ed071-5cc7-41e7-ba30-fcdc8acaedd8 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:47.383606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9cfd9-8dd3-4367-8f37-5e5de234805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:47.386375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9cfd9-8dd3-4367-8f37-5e5de234805d admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:47.386375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9cfd9-8dd3-4367-8f37-5e5de234805d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:47.386375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9cfd9-8dd3-4367-8f37-5e5de234805d admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:47.386375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9cfd9-8dd3-4367-8f37-5e5de234805d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:47.387585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9cfd9-8dd3-4367-8f37-5e5de234805d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:47.399172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1175/2321] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:55:47.403187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7425c-51ea-4ce1-afdd-71c3b96a7f7f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:47.414252 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7425c-51ea-4ce1-afdd-71c3b96a7f7f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:47.419047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06931030-3166-476e-9e86-ab4d21d5e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:47.419752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06931030-3166-476e-9e86-ab4d21d5e36b admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:47.420039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06931030-3166-476e-9e86-ab4d21d5e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:47.420320 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06931030-3166-476e-9e86-ab4d21d5e36b admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:47.421040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06931030-3166-476e-9e86-ab4d21d5e36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:47.422720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06931030-3166-476e-9e86-ab4d21d5e36b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:47.434326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1147/2322] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:55:47.438484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9cfd9-8dd3-4367-8f37-5e5de234805d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:47.449268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9cfd9-8dd3-4367-8f37-5e5de234805d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:47.454128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8d9d-8fce-4439-9e79-358d47040613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:47.455013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8d9d-8fce-4439-9e79-358d47040613 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:47.455294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8d9d-8fce-4439-9e79-358d47040613 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:47.455602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8d9d-8fce-4439-9e79-358d47040613 admin admin] PATH_INFO: `/v3/projects/3d6a5ff3a94f4e278fb35a19d6f709cf/users/166c6b2ddc694bd3a234a34dd871a301/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:47.471370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb8d9d-8fce-4439-9e79-358d47040613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6a5ff3a94f4e278fb35a19d6f709cf, user_id=166c6b2ddc694bd3a234a34dd871a301, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:47.474619 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb8d9d-8fce-4439-9e79-358d47040613 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:47.550512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1176/2323] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:55:47 2022] PUT /identity/v3/projects/3d6a5ff3a94f4e278fb35a19d6f709cf/users/166c6b2ddc694bd3a234a34dd871a301/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:55:47.561176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8f44-59d0-43b9-9472-c96faf15f0c2 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:47.561470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8f44-59d0-43b9-9472-c96faf15f0c2 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:47.561751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8f44-59d0-43b9-9472-c96faf15f0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:47.588862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-0a0d8f44-59d0-43b9-9472-c96faf15f0c2 None None] MFA Rules not processed for user `166c6b2ddc694bd3a234a34dd871a301`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:47.590084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0a0d8f44-59d0-43b9-9472-c96faf15f0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:47.654713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1148/2324] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:55:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:47.666576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8d9d-8fce-4439-9e79-358d47040613 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:47.668400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a0eb8d9d-8fce-4439-9e79-358d47040613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:47.690593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:47.727313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8d9d-8fce-4439-9e79-358d47040613 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:47.731099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5819af-d4ec-4682-9408-00a1bde789e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:47.731811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5819af-d4ec-4682-9408-00a1bde789e2 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:47.732100 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5819af-d4ec-4682-9408-00a1bde789e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:47.732383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5819af-d4ec-4682-9408-00a1bde789e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:47.741075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5819af-d4ec-4682-9408-00a1bde789e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:47.742506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5819af-d4ec-4682-9408-00a1bde789e2 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:47.751551 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1177/2325] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:55:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:55:47.775942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d8f44-59d0-43b9-9472-c96faf15f0c2 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:47.797327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:47.843036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d8f44-59d0-43b9-9472-c96faf15f0c2 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:47.847693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:47.848574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:47.848934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:47.849982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] PATH_INFO: `/v3/users/166c6b2ddc694bd3a234a34dd871a301` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:47.851224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=166c6b2ddc694bd3a234a34dd871a301)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:47.853190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:48.026450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166c6b2ddc694bd3a234a34dd871a301'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:48.034132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166c6b2ddc694bd3a234a34dd871a301'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:48.110256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166c6b2ddc694bd3a234a34dd871a301'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:48.110897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166c6b2ddc694bd3a234a34dd871a301'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:48.111556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166c6b2ddc694bd3a234a34dd871a301'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:48.130829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1149/2326] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:55:47 2022] DELETE /identity/v3/users/166c6b2ddc694bd3a234a34dd871a301 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:55:48.135639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93803d2b-d6ef-4d7d-b267-52f87670a61d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:48.135926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93803d2b-d6ef-4d7d-b267-52f87670a61d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:48.136208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93803d2b-d6ef-4d7d-b267-52f87670a61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:48.155074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-93803d2b-d6ef-4d7d-b267-52f87670a61d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:48.156324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-93803d2b-d6ef-4d7d-b267-52f87670a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:48.218117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1178/2327] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:48.228727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:48.230208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:48.294913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc022bf1-c218-4045-9935-c4cc5a6e6cef admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:48.298588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7c35-764e-4ecf-8081-4fa6d8ca5c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:48.299252 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7c35-764e-4ecf-8081-4fa6d8ca5c72 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:48.299565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7c35-764e-4ecf-8081-4fa6d8ca5c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:48.299843 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7c35-764e-4ecf-8081-4fa6d8ca5c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:48.310741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7c35-764e-4ecf-8081-4fa6d8ca5c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:48.312229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7c35-764e-4ecf-8081-4fa6d8ca5c72 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:48.323614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1150/2328] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:55:48.700860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93803d2b-d6ef-4d7d-b267-52f87670a61d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:48.702364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-93803d2b-d6ef-4d7d-b267-52f87670a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:48.715934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93803d2b-d6ef-4d7d-b267-52f87670a61d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:48.721249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:48.722184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:48.722465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:48.722738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] PATH_INFO: `/v3/projects/3d6a5ff3a94f4e278fb35a19d6f709cf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:48.724608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6a5ff3a94f4e278fb35a19d6f709cf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:48.727459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:48.825195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6a5ff3a94f4e278fb35a19d6f709cf', 'request_id': 'req-1e306f02-7e6c-4491-911b-eeafae923ef8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:48.831370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6a5ff3a94f4e278fb35a19d6f709cf', 'request_id': 'req-1e306f02-7e6c-4491-911b-eeafae923ef8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:48.837277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6a5ff3a94f4e278fb35a19d6f709cf', 'request_id': 'req-1e306f02-7e6c-4491-911b-eeafae923ef8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:48.887548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] The token cache is being invalidate because project 3d6a5ff3a94f4e278fb35a19d6f709cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:55:48.887848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:48.889036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1e306f02-7e6c-4491-911b-eeafae923ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:55:48.890651 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1179/2329] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:55:48 2022] DELETE /identity/v3/projects/3d6a5ff3a94f4e278fb35a19d6f709cf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:55:48.896026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78792e5-e843-437c-8b54-abb976ded3a8 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:48.896404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78792e5-e843-437c-8b54-abb976ded3a8 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:48.896682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78792e5-e843-437c-8b54-abb976ded3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:48.916144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f78792e5-e843-437c-8b54-abb976ded3a8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:48.917374 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f78792e5-e843-437c-8b54-abb976ded3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:48.953832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:48.980578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1151/2330] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:48.988529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53674150-e24e-4415-bd98-d0a18f7233fc None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:48.988823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53674150-e24e-4415-bd98-d0a18f7233fc None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:48.989103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53674150-e24e-4415-bd98-d0a18f7233fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:49.010779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-53674150-e24e-4415-bd98-d0a18f7233fc None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:49.010779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-53674150-e24e-4415-bd98-d0a18f7233fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:49.024760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1180/2331] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:49.028149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78792e5-e843-437c-8b54-abb976ded3a8 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:49.053014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78792e5-e843-437c-8b54-abb976ded3a8 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:49.062267 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cac40-0b36-4c23-bdfb-ee81f87da53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:49.063725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cac40-0b36-4c23-bdfb-ee81f87da53e admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:49.064286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cac40-0b36-4c23-bdfb-ee81f87da53e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:49.069333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cac40-0b36-4c23-bdfb-ee81f87da53e admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:49.069333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cac40-0b36-4c23-bdfb-ee81f87da53e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:55:49.069333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cac40-0b36-4c23-bdfb-ee81f87da53e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:49.070023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cac40-0b36-4c23-bdfb-ee81f87da53e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:49.084047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1152/2332] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:55:49.088529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53674150-e24e-4415-bd98-d0a18f7233fc None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:49.100313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53674150-e24e-4415-bd98-d0a18f7233fc None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:49.105553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ce755-eb3c-402c-8c04-69e590e8bd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:49.106228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ce755-eb3c-402c-8c04-69e590e8bd45 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:49.106515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ce755-eb3c-402c-8c04-69e590e8bd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:49.106793 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ce755-eb3c-402c-8c04-69e590e8bd45 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:49.107563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ce755-eb3c-402c-8c04-69e590e8bd45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:49.109506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ce755-eb3c-402c-8c04-69e590e8bd45 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:49.209532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1181/2333] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:55:49 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:55:49.214960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cac40-0b36-4c23-bdfb-ee81f87da53e admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:49.225589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cac40-0b36-4c23-bdfb-ee81f87da53e admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:49.295632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027df23-5ac6-45ae-8612-d082a3bc77ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:49.295632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027df23-5ac6-45ae-8612-d082a3bc77ba admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:49.295632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027df23-5ac6-45ae-8612-d082a3bc77ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:49.295632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027df23-5ac6-45ae-8612-d082a3bc77ba admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:49.295983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027df23-5ac6-45ae-8612-d082a3bc77ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:49.296600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027df23-5ac6-45ae-8612-d082a3bc77ba admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:49.381408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1153/2334] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:55:49 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:55:49.385974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ce755-eb3c-402c-8c04-69e590e8bd45 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:49.398314 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ce755-eb3c-402c-8c04-69e590e8bd45 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:49.403223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8d55f-dc65-4c34-801e-3468e7301c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:49.403942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8d55f-dc65-4c34-801e-3468e7301c8a admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:49.404230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8d55f-dc65-4c34-801e-3468e7301c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:49.404509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8d55f-dc65-4c34-801e-3468e7301c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:49.406528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8d55f-dc65-4c34-801e-3468e7301c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:49.406931 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8d55f-dc65-4c34-801e-3468e7301c8a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:49.418613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1182/2335] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:55:49.422691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027df23-5ac6-45ae-8612-d082a3bc77ba admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:49.435306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027df23-5ac6-45ae-8612-d082a3bc77ba admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:49.440602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00501e-0f23-419c-8d4c-a9cd80bd8b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:49.441286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00501e-0f23-419c-8d4c-a9cd80bd8b63 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:49.441569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00501e-0f23-419c-8d4c-a9cd80bd8b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:49.442014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00501e-0f23-419c-8d4c-a9cd80bd8b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:49.443687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00501e-0f23-419c-8d4c-a9cd80bd8b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:49.445269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00501e-0f23-419c-8d4c-a9cd80bd8b63 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:49.458491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1154/2336] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:55:49.462856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8d55f-dc65-4c34-801e-3468e7301c8a admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:49.476824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8d55f-dc65-4c34-801e-3468e7301c8a admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:49.481692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984eb8d-5a26-4242-aece-9a0dc943f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:49.492883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984eb8d-5a26-4242-aece-9a0dc943f482 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:49.492883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984eb8d-5a26-4242-aece-9a0dc943f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:49.492883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984eb8d-5a26-4242-aece-9a0dc943f482 admin admin] PATH_INFO: `/v3/projects/49b807a6e06848a29850010645811766/users/9ab6dae315c64134a48567c18af34b22/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:49.492883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:49.500488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984eb8d-5a26-4242-aece-9a0dc943f482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b807a6e06848a29850010645811766, user_id=9ab6dae315c64134a48567c18af34b22, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:49.503177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984eb8d-5a26-4242-aece-9a0dc943f482 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:49.579817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1183/2337] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:55:49 2022] PUT /identity/v3/projects/49b807a6e06848a29850010645811766/users/9ab6dae315c64134a48567c18af34b22/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:55:49.590213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3eeb5-6f3c-4cc3-8425-93ef3efaa254 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:49.590499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3eeb5-6f3c-4cc3-8425-93ef3efaa254 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:49.590783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3eeb5-6f3c-4cc3-8425-93ef3efaa254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:49.619243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-41b3eeb5-6f3c-4cc3-8425-93ef3efaa254 None None] MFA Rules not processed for user `9ab6dae315c64134a48567c18af34b22`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:55:49.620569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-41b3eeb5-6f3c-4cc3-8425-93ef3efaa254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:49.685908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1155/2338] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:55:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:55:49.697229 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984eb8d-5a26-4242-aece-9a0dc943f482 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:55:49.698929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7984eb8d-5a26-4242-aece-9a0dc943f482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:55:49.757831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984eb8d-5a26-4242-aece-9a0dc943f482 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:55:49.761574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e337f-e494-43d8-a29a-fc2370ded006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:55:49.762222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e337f-e494-43d8-a29a-fc2370ded006 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:55:49.762504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e337f-e494-43d8-a29a-fc2370ded006 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:55:49.762781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e337f-e494-43d8-a29a-fc2370ded006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:55:49.772194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e337f-e494-43d8-a29a-fc2370ded006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:55:49.773622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e337f-e494-43d8-a29a-fc2370ded006 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:55:49.787274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1184/2339] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:55:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:55:59.682620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:55:59.779113 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:01.099291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3eeb5-6f3c-4cc3-8425-93ef3efaa254 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:01.163139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3eeb5-6f3c-4cc3-8425-93ef3efaa254 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:01.167705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:01.168569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:01.168849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:01.169124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] PATH_INFO: `/v3/users/9ab6dae315c64134a48567c18af34b22` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:01.170300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab6dae315c64134a48567c18af34b22)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:01.172232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:01.313053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab6dae315c64134a48567c18af34b22'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.320472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab6dae315c64134a48567c18af34b22'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.401472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab6dae315c64134a48567c18af34b22'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.402091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab6dae315c64134a48567c18af34b22'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.402727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab6dae315c64134a48567c18af34b22'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:01.424146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1156/2340] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:56:01 2022] DELETE /identity/v3/users/9ab6dae315c64134a48567c18af34b22 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:01.429134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f665c-4370-47c1-a9a6-f77a4836d24e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:01.429795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f665c-4370-47c1-a9a6-f77a4836d24e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:01.429795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f665c-4370-47c1-a9a6-f77a4836d24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:01.449181 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-823f665c-4370-47c1-a9a6-f77a4836d24e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:01.450400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-823f665c-4370-47c1-a9a6-f77a4836d24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:01.514369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1185/2341] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:01.525161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:01.526639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:01.584968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44991cd9-d4a4-46bc-9430-4fcf9bf1310f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:01.588532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731399a-2f4f-4795-a161-bbca3cd15def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:01.589171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731399a-2f4f-4795-a161-bbca3cd15def service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:01.589452 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731399a-2f4f-4795-a161-bbca3cd15def service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:01.589728 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731399a-2f4f-4795-a161-bbca3cd15def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:01.598675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731399a-2f4f-4795-a161-bbca3cd15def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:01.600130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731399a-2f4f-4795-a161-bbca3cd15def service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:01.609552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1157/2342] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:02.007227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f665c-4370-47c1-a9a6-f77a4836d24e None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.009123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-823f665c-4370-47c1-a9a6-f77a4836d24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:02.024558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f665c-4370-47c1-a9a6-f77a4836d24e None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.041700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.044208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.044499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.044778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] PATH_INFO: `/v3/projects/49b807a6e06848a29850010645811766` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.046238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b807a6e06848a29850010645811766)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.049064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.185848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b807a6e06848a29850010645811766', 'request_id': 'req-9512b671-3a91-4410-952b-2a4d3a89af1a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:02.197424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b807a6e06848a29850010645811766', 'request_id': 'req-9512b671-3a91-4410-952b-2a4d3a89af1a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:02.204835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b807a6e06848a29850010645811766', 'request_id': 'req-9512b671-3a91-4410-952b-2a4d3a89af1a'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:02.276128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] The token cache is being invalidate because project 49b807a6e06848a29850010645811766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:56:02.276460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:02.277753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9512b671-3a91-4410-952b-2a4d3a89af1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:02.279755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1186/2343] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:56:02 2022] DELETE /identity/v3/projects/49b807a6e06848a29850010645811766 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:02.284916 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16e16b-6967-4c91-a9e3-52431db54513 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.285435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16e16b-6967-4c91-a9e3-52431db54513 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.285730 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16e16b-6967-4c91-a9e3-52431db54513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.309410 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5e16e16b-6967-4c91-a9e3-52431db54513 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:02.310746 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5e16e16b-6967-4c91-a9e3-52431db54513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:02.335086 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:02.393160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1158/2344] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:02.402153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1e2c3-bee4-4570-9c9f-44731c8cf357 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.402633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1e2c3-bee4-4570-9c9f-44731c8cf357 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.408404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1e2c3-bee4-4570-9c9f-44731c8cf357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.424936 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-88e1e2c3-bee4-4570-9c9f-44731c8cf357 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:02.426374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-88e1e2c3-bee4-4570-9c9f-44731c8cf357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:02.438834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1187/2345] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:02.441083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16e16b-6967-4c91-a9e3-52431db54513 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.458630 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16e16b-6967-4c91-a9e3-52431db54513 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.464990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287eecc-2edf-485d-acbd-7e0b447c3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.465815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287eecc-2edf-485d-acbd-7e0b447c3168 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.466107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287eecc-2edf-485d-acbd-7e0b447c3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.466385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287eecc-2edf-485d-acbd-7e0b447c3168 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.468662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287eecc-2edf-485d-acbd-7e0b447c3168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:56:02.468662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287eecc-2edf-485d-acbd-7e0b447c3168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.469156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287eecc-2edf-485d-acbd-7e0b447c3168 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.487090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1159/2346] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:56:02.488296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1e2c3-bee4-4570-9c9f-44731c8cf357 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.499067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1e2c3-bee4-4570-9c9f-44731c8cf357 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.504028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa881-7251-45a3-9609-6e948e0f7538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.505208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa881-7251-45a3-9609-6e948e0f7538 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.505628 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa881-7251-45a3-9609-6e948e0f7538 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.505910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa881-7251-45a3-9609-6e948e0f7538 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.506610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aa881-7251-45a3-9609-6e948e0f7538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.508655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aa881-7251-45a3-9609-6e948e0f7538 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.592778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1188/2347] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:56:02 2022] POST /identity/v3/projects => generated 395 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:56:02.597120 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287eecc-2edf-485d-acbd-7e0b447c3168 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.609349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287eecc-2edf-485d-acbd-7e0b447c3168 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.689641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915f7ef-9dc0-4dfd-a605-2587a38af876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.690239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915f7ef-9dc0-4dfd-a605-2587a38af876 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.690529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915f7ef-9dc0-4dfd-a605-2587a38af876 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.690902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915f7ef-9dc0-4dfd-a605-2587a38af876 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.691717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915f7ef-9dc0-4dfd-a605-2587a38af876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.694877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915f7ef-9dc0-4dfd-a605-2587a38af876 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.777556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1160/2348] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:56:02 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:56:02.780831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa881-7251-45a3-9609-6e948e0f7538 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.797610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa881-7251-45a3-9609-6e948e0f7538 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.806768 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac329b9e-8eec-4bd7-866c-a77cc68e8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.808142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329b9e-8eec-4bd7-866c-a77cc68e8547 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.808627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329b9e-8eec-4bd7-866c-a77cc68e8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.809246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329b9e-8eec-4bd7-866c-a77cc68e8547 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.810592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac329b9e-8eec-4bd7-866c-a77cc68e8547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.813557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac329b9e-8eec-4bd7-866c-a77cc68e8547 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.829980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1189/2349] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:56:02.833856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915f7ef-9dc0-4dfd-a605-2587a38af876 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.849483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915f7ef-9dc0-4dfd-a605-2587a38af876 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.858521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a0cdb-5e27-4740-8e83-128db7f9584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.859658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a0cdb-5e27-4740-8e83-128db7f9584e admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.860215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a0cdb-5e27-4740-8e83-128db7f9584e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.860647 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a0cdb-5e27-4740-8e83-128db7f9584e admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.862204 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a0cdb-5e27-4740-8e83-128db7f9584e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.867290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a0cdb-5e27-4740-8e83-128db7f9584e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:02.886833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1161/2350] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:56:02.892321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac329b9e-8eec-4bd7-866c-a77cc68e8547 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:02.907438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac329b9e-8eec-4bd7-866c-a77cc68e8547 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:02.915615 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74599ed9-feab-4f55-bc43-1d29f63de91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:02.916553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599ed9-feab-4f55-bc43-1d29f63de91b admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:02.916852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599ed9-feab-4f55-bc43-1d29f63de91b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:02.917104 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599ed9-feab-4f55-bc43-1d29f63de91b admin admin] PATH_INFO: `/v3/projects/8229d1e9d3fd4a9c9340dedcef6c87a1/users/52b6f28d67ba470fa71bb99d22089fb5/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:02.943294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74599ed9-feab-4f55-bc43-1d29f63de91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8229d1e9d3fd4a9c9340dedcef6c87a1, user_id=52b6f28d67ba470fa71bb99d22089fb5, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:02.946085 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74599ed9-feab-4f55-bc43-1d29f63de91b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:03.033960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1190/2351] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:56:02 2022] PUT /identity/v3/projects/8229d1e9d3fd4a9c9340dedcef6c87a1/users/52b6f28d67ba470fa71bb99d22089fb5/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:03.044887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ccc62-dca4-4c69-9495-c05b345bd6b6 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:03.045461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ccc62-dca4-4c69-9495-c05b345bd6b6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:03.045847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ccc62-dca4-4c69-9495-c05b345bd6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:03.090269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2f0ccc62-dca4-4c69-9495-c05b345bd6b6 None None] MFA Rules not processed for user `52b6f28d67ba470fa71bb99d22089fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:03.092401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2f0ccc62-dca4-4c69-9495-c05b345bd6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:03.177829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1162/2352] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:03.196722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74599ed9-feab-4f55-bc43-1d29f63de91b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:03.198754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-74599ed9-feab-4f55-bc43-1d29f63de91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:03.232860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:03.290746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74599ed9-feab-4f55-bc43-1d29f63de91b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:03.295923 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99486e-9507-4ec5-927a-6ec01bc6502a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:03.296604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99486e-9507-4ec5-927a-6ec01bc6502a service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:03.296889 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99486e-9507-4ec5-927a-6ec01bc6502a service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:03.297173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99486e-9507-4ec5-927a-6ec01bc6502a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:03.309367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99486e-9507-4ec5-927a-6ec01bc6502a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:03.310873 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99486e-9507-4ec5-927a-6ec01bc6502a service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:03.322378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1191/2353] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:13.173170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:13.587309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=17 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:14.909681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ccc62-dca4-4c69-9495-c05b345bd6b6 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:14.979482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ccc62-dca4-4c69-9495-c05b345bd6b6 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:14.983973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:14.984852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:14.985132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:14.985405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] PATH_INFO: `/v3/users/52b6f28d67ba470fa71bb99d22089fb5` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:14.986606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b6f28d67ba470fa71bb99d22089fb5)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:14.988585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:15.153458 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b6f28d67ba470fa71bb99d22089fb5'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:15.160787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b6f28d67ba470fa71bb99d22089fb5'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:15.230047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b6f28d67ba470fa71bb99d22089fb5'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:15.230662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b6f28d67ba470fa71bb99d22089fb5'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:15.231289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b6f28d67ba470fa71bb99d22089fb5'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:15.249601 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1163/2354] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:56:14 2022] DELETE /identity/v3/users/52b6f28d67ba470fa71bb99d22089fb5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:15.254268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5cbf1-0ea2-462c-ad57-1b17890a8bdf None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:15.255238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5cbf1-0ea2-462c-ad57-1b17890a8bdf None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:15.255512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5cbf1-0ea2-462c-ad57-1b17890a8bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:15.278038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-dfd5cbf1-0ea2-462c-ad57-1b17890a8bdf None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:15.279178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-dfd5cbf1-0ea2-462c-ad57-1b17890a8bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:15.347552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1192/2355] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:15.358149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:15.359615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:15.425746 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140577f-59ff-4c1d-bbb5-86aab57b8f6a admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:15.430077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc7a12-71df-4e9e-a922-f230b2b083f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:15.430739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc7a12-71df-4e9e-a922-f230b2b083f8 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:15.431025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc7a12-71df-4e9e-a922-f230b2b083f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:15.431310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc7a12-71df-4e9e-a922-f230b2b083f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:15.441562 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc7a12-71df-4e9e-a922-f230b2b083f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:15.443734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc7a12-71df-4e9e-a922-f230b2b083f8 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:15.454254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1164/2356] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:15.877458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5cbf1-0ea2-462c-ad57-1b17890a8bdf None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:15.878869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-dfd5cbf1-0ea2-462c-ad57-1b17890a8bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:15.895692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5cbf1-0ea2-462c-ad57-1b17890a8bdf None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:15.902304 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:15.903715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:15.904002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:15.904281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] PATH_INFO: `/v3/projects/8229d1e9d3fd4a9c9340dedcef6c87a1` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:15.905508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8229d1e9d3fd4a9c9340dedcef6c87a1)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:15.907464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:16.053608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8229d1e9d3fd4a9c9340dedcef6c87a1', 'request_id': 'req-1f43457e-ad2d-4575-98a0-5937bc832665'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:16.063573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8229d1e9d3fd4a9c9340dedcef6c87a1', 'request_id': 'req-1f43457e-ad2d-4575-98a0-5937bc832665'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:16.074165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8229d1e9d3fd4a9c9340dedcef6c87a1', 'request_id': 'req-1f43457e-ad2d-4575-98a0-5937bc832665'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:16.158603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] The token cache is being invalidate because project 8229d1e9d3fd4a9c9340dedcef6c87a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:56:16.159054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:16.159658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:16.165497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1193/2357] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:56:15 2022] DELETE /identity/v3/projects/8229d1e9d3fd4a9c9340dedcef6c87a1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:23.980227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a1c1-7fef-403e-a4ec-17de178c06b2 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:23.980748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a1c1-7fef-403e-a4ec-17de178c06b2 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:23.980852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a1c1-7fef-403e-a4ec-17de178c06b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:24.000418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d6f3a1c1-7fef-403e-a4ec-17de178c06b2 None None] MFA Rules not processed for user `01bb3df8b4b649388d1a0f6c24e18f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:24.001683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d6f3a1c1-7fef-403e-a4ec-17de178c06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:24.019199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:24.059313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1165/2358] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:26.154989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:31.860714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:31.862281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:31.944692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43457e-ad2d-4575-98a0-5937bc832665 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:31.956754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:31.958347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:31.958625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:31.958902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] PATH_INFO: `/v3/users/f571731515754890874b862a1407ebc0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:31.960185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f571731515754890874b862a1407ebc0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:31.962208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:32.170254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f571731515754890874b862a1407ebc0'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:32.182935 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f571731515754890874b862a1407ebc0'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:32.246782 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f571731515754890874b862a1407ebc0'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:32.254287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f571731515754890874b862a1407ebc0'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:32.254947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-520f98d0-1073-4a6d-9af0-c1d42142d066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f571731515754890874b862a1407ebc0'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:32.260956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1194/2359] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:56:31 2022] DELETE /identity/v3/users/f571731515754890874b862a1407ebc0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:32.517103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a1c1-7fef-403e-a4ec-17de178c06b2 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:32.530707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a1c1-7fef-403e-a4ec-17de178c06b2 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:32.589381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:32.590280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:32.590565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:32.591497 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] PATH_INFO: `/v3/projects/25f8de28a0664821af43d9cdccab292d` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:32.592722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f8de28a0664821af43d9cdccab292d)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:32.594690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:32.727881 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f8de28a0664821af43d9cdccab292d', 'request_id': 'req-cfebb58c-8bda-4164-9c28-d462ab9a4c51'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:32.733875 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f8de28a0664821af43d9cdccab292d', 'request_id': 'req-cfebb58c-8bda-4164-9c28-d462ab9a4c51'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:32.739332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f8de28a0664821af43d9cdccab292d', 'request_id': 'req-cfebb58c-8bda-4164-9c28-d462ab9a4c51'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:32.823656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] The token cache is being invalidate because project 25f8de28a0664821af43d9cdccab292d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:56:32.823938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:32.824551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cfebb58c-8bda-4164-9c28-d462ab9a4c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:32.826131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1166/2360] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:56:32 2022] DELETE /identity/v3/projects/25f8de28a0664821af43d9cdccab292d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:32.831274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53155e5f-9a12-49d9-b16e-1161085f067b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:32.831557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53155e5f-9a12-49d9-b16e-1161085f067b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:32.831844 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53155e5f-9a12-49d9-b16e-1161085f067b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:32.852505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-53155e5f-9a12-49d9-b16e-1161085f067b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:32.853717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-53155e5f-9a12-49d9-b16e-1161085f067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:32.914199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1195/2361] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:32.921804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6198b-0380-45a9-9a59-1da7c11c3f8a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:32.922093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6198b-0380-45a9-9a59-1da7c11c3f8a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:32.922374 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6198b-0380-45a9-9a59-1da7c11c3f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:32.940976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-04f6198b-0380-45a9-9a59-1da7c11c3f8a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:32.942836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-04f6198b-0380-45a9-9a59-1da7c11c3f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:32.951108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1167/2362] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:32.955632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53155e5f-9a12-49d9-b16e-1161085f067b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:32.967029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53155e5f-9a12-49d9-b16e-1161085f067b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:32.972031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049000ec-2764-4757-af34-045c2f10d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:32.973073 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049000ec-2764-4757-af34-045c2f10d22b admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:32.973359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049000ec-2764-4757-af34-045c2f10d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:32.973635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049000ec-2764-4757-af34-045c2f10d22b admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:32.974402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049000ec-2764-4757-af34-045c2f10d22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:56:32.974711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049000ec-2764-4757-af34-045c2f10d22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:32.976633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049000ec-2764-4757-af34-045c2f10d22b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:32.990709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1196/2363] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:56:32.995418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6198b-0380-45a9-9a59-1da7c11c3f8a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:33.006429 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6198b-0380-45a9-9a59-1da7c11c3f8a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:33.011964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89013d8-d6df-499a-94b8-75866cbfe916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:33.012649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89013d8-d6df-499a-94b8-75866cbfe916 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:33.012941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89013d8-d6df-499a-94b8-75866cbfe916 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:33.013225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89013d8-d6df-499a-94b8-75866cbfe916 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:33.013970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89013d8-d6df-499a-94b8-75866cbfe916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:33.015979 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89013d8-d6df-499a-94b8-75866cbfe916 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:33.120106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1168/2364] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:56:32 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:56:33.123636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049000ec-2764-4757-af34-045c2f10d22b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:33.134812 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049000ec-2764-4757-af34-045c2f10d22b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:33.138816 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:33.201740 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c305d-f519-41bc-bc9c-6d2ace3fff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:33.202454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c305d-f519-41bc-bc9c-6d2ace3fff0c admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:33.202734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c305d-f519-41bc-bc9c-6d2ace3fff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:33.203009 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c305d-f519-41bc-bc9c-6d2ace3fff0c admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:33.203741 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c305d-f519-41bc-bc9c-6d2ace3fff0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:33.205708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c305d-f519-41bc-bc9c-6d2ace3fff0c admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:33.357386 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1197/2365] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:56:33 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:56:33.369409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89013d8-d6df-499a-94b8-75866cbfe916 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:33.381638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89013d8-d6df-499a-94b8-75866cbfe916 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:33.387169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08fa2a-4ecb-40b4-b9f3-d82d9952d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:33.387906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08fa2a-4ecb-40b4-b9f3-d82d9952d818 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:33.388435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08fa2a-4ecb-40b4-b9f3-d82d9952d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:33.388711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08fa2a-4ecb-40b4-b9f3-d82d9952d818 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:33.389732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08fa2a-4ecb-40b4-b9f3-d82d9952d818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:33.391440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08fa2a-4ecb-40b4-b9f3-d82d9952d818 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:33.422896 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1169/2366] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:56:33.428097 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c305d-f519-41bc-bc9c-6d2ace3fff0c admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:33.439033 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c305d-f519-41bc-bc9c-6d2ace3fff0c admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:33.444858 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21b4c8-40ff-46b4-98ba-3b0137819743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:33.445550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b4c8-40ff-46b4-98ba-3b0137819743 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:33.445831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b4c8-40ff-46b4-98ba-3b0137819743 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:33.446107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b4c8-40ff-46b4-98ba-3b0137819743 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:33.446896 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21b4c8-40ff-46b4-98ba-3b0137819743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:33.448549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21b4c8-40ff-46b4-98ba-3b0137819743 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:33.460454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1198/2367] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:56:33.464827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08fa2a-4ecb-40b4-b9f3-d82d9952d818 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:33.475768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08fa2a-4ecb-40b4-b9f3-d82d9952d818 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:33.480897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4fa93-f686-4fad-b183-33bf658dfdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:33.481817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4fa93-f686-4fad-b183-33bf658dfdb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:33.482098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4fa93-f686-4fad-b183-33bf658dfdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:33.482371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4fa93-f686-4fad-b183-33bf658dfdb3 admin admin] PATH_INFO: `/v3/projects/d626b75636304707b6209b05580e1d4d/users/c6fabf4082aa45d0b73598611040bdde/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:33.503952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4fa93-f686-4fad-b183-33bf658dfdb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d626b75636304707b6209b05580e1d4d, user_id=c6fabf4082aa45d0b73598611040bdde, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:33.503952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4fa93-f686-4fad-b183-33bf658dfdb3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:33.506361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:33.596009 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1170/2368] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:56:33 2022] PUT /identity/v3/projects/d626b75636304707b6209b05580e1d4d/users/c6fabf4082aa45d0b73598611040bdde/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:33.606305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83001458-ce87-4794-bc54-f14c0c2796e8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:33.606596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83001458-ce87-4794-bc54-f14c0c2796e8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:33.606876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83001458-ce87-4794-bc54-f14c0c2796e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:33.648728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-83001458-ce87-4794-bc54-f14c0c2796e8 None None] MFA Rules not processed for user `c6fabf4082aa45d0b73598611040bdde`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:33.649957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-83001458-ce87-4794-bc54-f14c0c2796e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:33.716194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1199/2369] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:33.727735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4fa93-f686-4fad-b183-33bf658dfdb3 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:33.729447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-05b4fa93-f686-4fad-b183-33bf658dfdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:33.796868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4fa93-f686-4fad-b183-33bf658dfdb3 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:33.800774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14aab4-fc7e-4457-ba6b-3246030225d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:33.802199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14aab4-fc7e-4457-ba6b-3246030225d8 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:33.802553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14aab4-fc7e-4457-ba6b-3246030225d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:33.802761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14aab4-fc7e-4457-ba6b-3246030225d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:33.812380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14aab4-fc7e-4457-ba6b-3246030225d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:33.813836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14aab4-fc7e-4457-ba6b-3246030225d8 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:33.824484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1171/2370] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:43.713061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:43.944145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:45.695985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52e1b8-0d7c-437c-9c4a-ad2c842face5 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:45.696499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52e1b8-0d7c-437c-9c4a-ad2c842face5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:45.696624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52e1b8-0d7c-437c-9c4a-ad2c842face5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:45.715175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-ff52e1b8-0d7c-437c-9c4a-ad2c842face5 None None] MFA Rules not processed for user `b0eb46b0aeeb46fe8dcdb02f29ae4013`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:45.716523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ff52e1b8-0d7c-437c-9c4a-ad2c842face5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:45.772707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1200/2371] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:45.810693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14aab4-fc7e-4457-ba6b-3246030225d8 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:45.812090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4b14aab4-fc7e-4457-ba6b-3246030225d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:45.871182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14aab4-fc7e-4457-ba6b-3246030225d8 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:45.874843 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc477e-88b1-4270-8d3a-9ad421ddbb77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd039be6500e74ae3a6f30821c5c19a99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:45.875600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc477e-88b1-4270-8d3a-9ad421ddbb77 service glance] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:45.887087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc477e-88b1-4270-8d3a-9ad421ddbb77 service glance] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:45.887087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc477e-88b1-4270-8d3a-9ad421ddbb77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:45.887087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2adc477e-88b1-4270-8d3a-9ad421ddbb77 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:45.951051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc477e-88b1-4270-8d3a-9ad421ddbb77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:45.952448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc477e-88b1-4270-8d3a-9ad421ddbb77 service glance] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:45.964551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1172/2372] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:46.721769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52e1b8-0d7c-437c-9c4a-ad2c842face5 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:46.724226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ff52e1b8-0d7c-437c-9c4a-ad2c842face5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:46.791389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52e1b8-0d7c-437c-9c4a-ad2c842face5 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:46.795231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81975939-39cc-4524-8e56-7d7391325f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:46.795983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81975939-39cc-4524-8e56-7d7391325f1d service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:46.796195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81975939-39cc-4524-8e56-7d7391325f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:46.796478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81975939-39cc-4524-8e56-7d7391325f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:46.798337 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-81975939-39cc-4524-8e56-7d7391325f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:46.813625 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81975939-39cc-4524-8e56-7d7391325f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:46.815101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81975939-39cc-4524-8e56-7d7391325f1d service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:46.827330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1201/2373] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:54.875855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc477e-88b1-4270-8d3a-9ad421ddbb77 service glance] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:54.877364 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2adc477e-88b1-4270-8d3a-9ad421ddbb77 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:54.891458 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc477e-88b1-4270-8d3a-9ad421ddbb77 service glance] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:54.897044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea385d3-a888-45c0-9dec-c90f53a30b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:54.897685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea385d3-a888-45c0-9dec-c90f53a30b89 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:54.897968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea385d3-a888-45c0-9dec-c90f53a30b89 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:54.898245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea385d3-a888-45c0-9dec-c90f53a30b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:54.900064 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-bea385d3-a888-45c0-9dec-c90f53a30b89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:54.911496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea385d3-a888-45c0-9dec-c90f53a30b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:54.913082 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea385d3-a888-45c0-9dec-c90f53a30b89 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:54.922321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1173/2374] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:55.034211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81975939-39cc-4524-8e56-7d7391325f1d service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:55.101020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81975939-39cc-4524-8e56-7d7391325f1d service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:55.105582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:55.106459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:55.106744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:55.107023 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] PATH_INFO: `/v3/users/c6fabf4082aa45d0b73598611040bdde` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:55.108249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fabf4082aa45d0b73598611040bdde)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:55.110175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:55.312566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fabf4082aa45d0b73598611040bdde'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:55.314346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:55.324691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fabf4082aa45d0b73598611040bdde'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:55.401582 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fabf4082aa45d0b73598611040bdde'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:55.409091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fabf4082aa45d0b73598611040bdde'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:55.411475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fabf4082aa45d0b73598611040bdde'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:55.416380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1202/2375] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:56:55 2022] DELETE /identity/v3/users/c6fabf4082aa45d0b73598611040bdde => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:56:55.420997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee07e4-c4d7-46e6-b26f-97d3903a7297 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:55.421288 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee07e4-c4d7-46e6-b26f-97d3903a7297 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:55.421571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee07e4-c4d7-46e6-b26f-97d3903a7297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:55.439887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-37ee07e4-c4d7-46e6-b26f-97d3903a7297 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:56:55.441883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-37ee07e4-c4d7-46e6-b26f-97d3903a7297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:55.501903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1174/2376] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:56:55.512783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:55.515263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:55.574198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defffd4e-0e33-48ce-b826-9f02eeba94a0 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:55.577752 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c06dc-9d5f-492c-85d9-18981fd26732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:55.578396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c06dc-9d5f-492c-85d9-18981fd26732 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:55.578691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c06dc-9d5f-492c-85d9-18981fd26732 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:55.578952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c06dc-9d5f-492c-85d9-18981fd26732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:55.588853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c06dc-9d5f-492c-85d9-18981fd26732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:55.590267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c06dc-9d5f-492c-85d9-18981fd26732 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:55.599966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1203/2377] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:56:56.071484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee07e4-c4d7-46e6-b26f-97d3903a7297 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:56:56.072983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-37ee07e4-c4d7-46e6-b26f-97d3903a7297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:56:56.089025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee07e4-c4d7-46e6-b26f-97d3903a7297 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:56:56.106317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:56:56.107745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:56:56.108094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:56:56.108465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] PATH_INFO: `/v3/projects/d626b75636304707b6209b05580e1d4d` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:56:56.110065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d626b75636304707b6209b05580e1d4d)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:56:56.112053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:56:56.138235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:56:56.260235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd626b75636304707b6209b05580e1d4d', 'request_id': 'req-7c00cff4-e844-47d5-a488-2220af2080f1'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:56.266664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd626b75636304707b6209b05580e1d4d', 'request_id': 'req-7c00cff4-e844-47d5-a488-2220af2080f1'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:56.272931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd626b75636304707b6209b05580e1d4d', 'request_id': 'req-7c00cff4-e844-47d5-a488-2220af2080f1'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:56.402580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] The token cache is being invalidate because project d626b75636304707b6209b05580e1d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:56:56.402998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:56.403953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:56:56.405733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1175/2378] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:56:56 2022] DELETE /identity/v3/projects/d626b75636304707b6209b05580e1d4d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:57:05.595426 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=37,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:06.399093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:14.964201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c06dc-9d5f-492c-85d9-18981fd26732 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:14.965426 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a71c06dc-9d5f-492c-85d9-18981fd26732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:15.108287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c06dc-9d5f-492c-85d9-18981fd26732 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:15.184026 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2121-284f-441e-863f-3d5d25f03ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:15.184819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2121-284f-441e-863f-3d5d25f03ad2 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:15.185358 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2121-284f-441e-863f-3d5d25f03ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:15.185733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2121-284f-441e-863f-3d5d25f03ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:15.188285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0b7d2121-284f-441e-863f-3d5d25f03ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:15.201854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d2121-284f-441e-863f-3d5d25f03ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:15.203627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d2121-284f-441e-863f-3d5d25f03ad2 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:15.220327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1204/2379] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:15.531914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:15.533464 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:15.598377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00cff4-e844-47d5-a488-2220af2080f1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:15.602330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c470e-6364-4d0e-8146-c7d63df30546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:15.603057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c470e-6364-4d0e-8146-c7d63df30546 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:15.603370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c470e-6364-4d0e-8146-c7d63df30546 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:15.603729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c470e-6364-4d0e-8146-c7d63df30546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:15.605785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-674c470e-6364-4d0e-8146-c7d63df30546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:15.616740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c470e-6364-4d0e-8146-c7d63df30546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:15.618308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c470e-6364-4d0e-8146-c7d63df30546 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:15.628129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1176/2380] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:21.025239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2121-284f-441e-863f-3d5d25f03ad2 service nova] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:21.027006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0b7d2121-284f-441e-863f-3d5d25f03ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:21.041268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2121-284f-441e-863f-3d5d25f03ad2 service nova] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:21.047900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18c176-3e72-46de-89ba-335a3a82cd22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:21.048646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c176-3e72-46de-89ba-335a3a82cd22 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:21.048932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c176-3e72-46de-89ba-335a3a82cd22 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:21.049253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18c176-3e72-46de-89ba-335a3a82cd22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:21.051297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-8d18c176-3e72-46de-89ba-335a3a82cd22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:21.125720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18c176-3e72-46de-89ba-335a3a82cd22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:21.127404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18c176-3e72-46de-89ba-335a3a82cd22 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:21.137518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1205/2381] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:25.623369 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=26 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:26.438159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc29d1-d2d5-4a2d-8d0c-9c179dad648b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:26.438465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc29d1-d2d5-4a2d-8d0c-9c179dad648b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:26.438766 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc29d1-d2d5-4a2d-8d0c-9c179dad648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:26.457433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f7fc29d1-d2d5-4a2d-8d0c-9c179dad648b None None] MFA Rules not processed for user `5e4214dbd10d491eb6afa50321edca88`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:57:26.461312 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f7fc29d1-d2d5-4a2d-8d0c-9c179dad648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:26.515155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1177/2382] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:57:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:57:26.896376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e8bfd-148f-4659-b1af-cc45337ade4a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:26.896975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e8bfd-148f-4659-b1af-cc45337ade4a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:26.896975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e8bfd-148f-4659-b1af-cc45337ade4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:26.917250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-838e8bfd-148f-4659-b1af-cc45337ade4a None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:57:26.918575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-838e8bfd-148f-4659-b1af-cc45337ade4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:26.938396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:26.982160 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1206/2383] 10.222.0.78 () {58 vars in 967 bytes} [Fri Jun 17 08:57:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:57:27.194262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc29d1-d2d5-4a2d-8d0c-9c179dad648b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:27.195768 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f7fc29d1-d2d5-4a2d-8d0c-9c179dad648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:27.272063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc29d1-d2d5-4a2d-8d0c-9c179dad648b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:27.277143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d2035-1e50-4e0b-aae5-328d27c18557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:27.277798 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d2035-1e50-4e0b-aae5-328d27c18557 service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:27.278080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d2035-1e50-4e0b-aae5-328d27c18557 service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:27.278365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d2035-1e50-4e0b-aae5-328d27c18557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:27.288084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d2035-1e50-4e0b-aae5-328d27c18557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:27.289710 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d2035-1e50-4e0b-aae5-328d27c18557 service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:27.298980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1178/2384] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:57:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:57:32.332458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e8bfd-148f-4659-b1af-cc45337ade4a None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:32.334907 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-838e8bfd-148f-4659-b1af-cc45337ade4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:32.453242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e8bfd-148f-4659-b1af-cc45337ade4a None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:32.466586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32458e-de34-45b5-92ea-d3c5176fa1e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:32.467524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32458e-de34-45b5-92ea-d3c5176fa1e3 service placement] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:32.468098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32458e-de34-45b5-92ea-d3c5176fa1e3 service placement] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:32.468509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32458e-de34-45b5-92ea-d3c5176fa1e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:32.472165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4e32458e-de34-45b5-92ea-d3c5176fa1e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:32.500313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32458e-de34-45b5-92ea-d3c5176fa1e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:32.506051 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32458e-de34-45b5-92ea-d3c5176fa1e3 service placement] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:32.523641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1207/2385] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:36.770504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d2035-1e50-4e0b-aae5-328d27c18557 service swift] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:36.772087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4a2d2035-1e50-4e0b-aae5-328d27c18557 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:36.848143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d2035-1e50-4e0b-aae5-328d27c18557 service swift] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:36.852879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:36.853759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:36.854044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:36.854322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] PATH_INFO: `/v3/users/b9ab8c84c68b4275b2f81b69d8a52826` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:36.855691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ab8c84c68b4275b2f81b69d8a52826)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:36.857625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:37.104103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:37.112998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ab8c84c68b4275b2f81b69d8a52826'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:37.119862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ab8c84c68b4275b2f81b69d8a52826'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:37.212157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ab8c84c68b4275b2f81b69d8a52826'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:37.212946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ab8c84c68b4275b2f81b69d8a52826'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:37.213549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ab8c84c68b4275b2f81b69d8a52826'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:37.231922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1179/2386] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:57:36 2022] DELETE /identity/v3/users/b9ab8c84c68b4275b2f81b69d8a52826 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:57:37.499822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32458e-de34-45b5-92ea-d3c5176fa1e3 service placement] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:37.530596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32458e-de34-45b5-92ea-d3c5176fa1e3 service placement] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:37.604884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:37.605758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:37.606040 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:37.606317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] PATH_INFO: `/v3/projects/45a0a44acc444e8eb9bba54a8e089f17` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:37.607717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a0a44acc444e8eb9bba54a8e089f17)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:37.609610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:37.728194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a0a44acc444e8eb9bba54a8e089f17', 'request_id': 'req-7d2ee6ba-c267-4bb7-b828-80106849869c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:37.734781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a0a44acc444e8eb9bba54a8e089f17', 'request_id': 'req-7d2ee6ba-c267-4bb7-b828-80106849869c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:37.739618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:37.742233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a0a44acc444e8eb9bba54a8e089f17', 'request_id': 'req-7d2ee6ba-c267-4bb7-b828-80106849869c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:37.823707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] The token cache is being invalidate because project 45a0a44acc444e8eb9bba54a8e089f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:57:37.823983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:37.824640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:37.826566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1208/2387] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:57:37 2022] DELETE /identity/v3/projects/45a0a44acc444e8eb9bba54a8e089f17 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:57:37.830953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:37.832725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:37.846886 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01f6bd-7f69-403e-942b-3423cfddadb1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:37.915171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:37.916187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:37.916488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:37.916924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] PATH_INFO: `/v3/users/6389cfbc816041baa75d44db9d1c5398` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:37.918198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6389cfbc816041baa75d44db9d1c5398)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:37.920399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:38.125088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6389cfbc816041baa75d44db9d1c5398'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:38.133098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6389cfbc816041baa75d44db9d1c5398'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:38.270751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6389cfbc816041baa75d44db9d1c5398'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:38.271538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6389cfbc816041baa75d44db9d1c5398'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:38.272518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-108c56c0-8710-4429-b9f4-c44c76009e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6389cfbc816041baa75d44db9d1c5398'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:38.301701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1180/2388] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:57:37 2022] DELETE /identity/v3/users/6389cfbc816041baa75d44db9d1c5398 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:57:38.816259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:38.818027 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:38.846678 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ee6ba-c267-4bb7-b828-80106849869c admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:38.944971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:38.946013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:38.946303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:38.946792 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] PATH_INFO: `/v3/projects/ccdf4c362cc34ba8b0ae36299712fa90` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:38.948511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccdf4c362cc34ba8b0ae36299712fa90)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:38.951971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:39.072937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccdf4c362cc34ba8b0ae36299712fa90', 'request_id': 'req-e03fe873-b720-4463-888a-3b82fb0d87be'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:39.086120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccdf4c362cc34ba8b0ae36299712fa90', 'request_id': 'req-e03fe873-b720-4463-888a-3b82fb0d87be'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:39.094070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccdf4c362cc34ba8b0ae36299712fa90', 'request_id': 'req-e03fe873-b720-4463-888a-3b82fb0d87be'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:39.174299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] The token cache is being invalidate because project ccdf4c362cc34ba8b0ae36299712fa90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:57:39.174631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:39.175272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e03fe873-b720-4463-888a-3b82fb0d87be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:57:39.177058 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1209/2389] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:57:38 2022] DELETE /identity/v3/projects/ccdf4c362cc34ba8b0ae36299712fa90 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:57:39.182595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5459ada-4f34-488c-a95b-bc9ac4d2326b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:39.183200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5459ada-4f34-488c-a95b-bc9ac4d2326b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:39.183200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5459ada-4f34-488c-a95b-bc9ac4d2326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:39.212800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b5459ada-4f34-488c-a95b-bc9ac4d2326b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:57:39.212800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b5459ada-4f34-488c-a95b-bc9ac4d2326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:39.254171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:39.289095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1181/2390] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:57:39.297960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a0d2e-17dd-43f2-9b9d-412aafb38384 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:39.298624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a0d2e-17dd-43f2-9b9d-412aafb38384 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:39.298905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a0d2e-17dd-43f2-9b9d-412aafb38384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:39.323686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b04a0d2e-17dd-43f2-9b9d-412aafb38384 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:57:39.324945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b04a0d2e-17dd-43f2-9b9d-412aafb38384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:39.334757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1210/2391] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:57:39.338812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5459ada-4f34-488c-a95b-bc9ac4d2326b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:39.349552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5459ada-4f34-488c-a95b-bc9ac4d2326b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:39.354343 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39d1e4-64fe-47ea-bee7-573b150cdef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:39.357735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d1e4-64fe-47ea-bee7-573b150cdef1 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:39.357735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d1e4-64fe-47ea-bee7-573b150cdef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:39.357735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39d1e4-64fe-47ea-bee7-573b150cdef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:39.357735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39d1e4-64fe-47ea-bee7-573b150cdef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:57:39.357735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39d1e4-64fe-47ea-bee7-573b150cdef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:39.358322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39d1e4-64fe-47ea-bee7-573b150cdef1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:39.371584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1182/2392] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 08:57:39.375205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a0d2e-17dd-43f2-9b9d-412aafb38384 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:39.387777 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a0d2e-17dd-43f2-9b9d-412aafb38384 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:39.394162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89fd24-fad8-4170-9f2a-25feecf2c32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:39.394988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89fd24-fad8-4170-9f2a-25feecf2c32c admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:39.395330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89fd24-fad8-4170-9f2a-25feecf2c32c admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:39.395716 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89fd24-fad8-4170-9f2a-25feecf2c32c admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:39.396492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89fd24-fad8-4170-9f2a-25feecf2c32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:39.398816 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89fd24-fad8-4170-9f2a-25feecf2c32c admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:39.485029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1211/2393] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:57:39 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:57:39.489308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39d1e4-64fe-47ea-bee7-573b150cdef1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:39.500143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39d1e4-64fe-47ea-bee7-573b150cdef1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:39.566087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9931c74-2a4c-4776-aec5-8c98c377638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:39.566695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9931c74-2a4c-4776-aec5-8c98c377638a admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:39.566982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9931c74-2a4c-4776-aec5-8c98c377638a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:39.567265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9931c74-2a4c-4776-aec5-8c98c377638a admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:39.568015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9931c74-2a4c-4776-aec5-8c98c377638a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:39.569946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9931c74-2a4c-4776-aec5-8c98c377638a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:39.693478 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1183/2394] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:57:39 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:57:39.697506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89fd24-fad8-4170-9f2a-25feecf2c32c admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:39.709487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89fd24-fad8-4170-9f2a-25feecf2c32c admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:39.714319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7cd42-5690-407a-baa2-9c37781c7521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:39.715061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7cd42-5690-407a-baa2-9c37781c7521 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:39.715421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7cd42-5690-407a-baa2-9c37781c7521 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:39.715711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7cd42-5690-407a-baa2-9c37781c7521 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:39.716541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7cd42-5690-407a-baa2-9c37781c7521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:39.718317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7cd42-5690-407a-baa2-9c37781c7521 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:39.730220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1212/2395] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:57:39.734100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9931c74-2a4c-4776-aec5-8c98c377638a admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:39.744651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9931c74-2a4c-4776-aec5-8c98c377638a admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:39.749698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85472193-73bc-4ecf-91b1-f09ec4ac5bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:39.750411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85472193-73bc-4ecf-91b1-f09ec4ac5bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:39.750718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85472193-73bc-4ecf-91b1-f09ec4ac5bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:39.751162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85472193-73bc-4ecf-91b1-f09ec4ac5bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:39.751989 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85472193-73bc-4ecf-91b1-f09ec4ac5bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:39.754275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85472193-73bc-4ecf-91b1-f09ec4ac5bb1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:39.765290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1184/2396] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:57:39.770359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7cd42-5690-407a-baa2-9c37781c7521 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:39.781126 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7cd42-5690-407a-baa2-9c37781c7521 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:39.786052 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784dda-d64b-4e87-b7fa-517ba8abdc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:39.787020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784dda-d64b-4e87-b7fa-517ba8abdc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:39.787330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784dda-d64b-4e87-b7fa-517ba8abdc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:39.787680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80784dda-d64b-4e87-b7fa-517ba8abdc46 admin admin] PATH_INFO: `/v3/projects/4c3ecf1efb8748a0af09e501e2b9d81b/users/61c06d41d371486c9856a17c5b2aee20/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:39.803627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80784dda-d64b-4e87-b7fa-517ba8abdc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3ecf1efb8748a0af09e501e2b9d81b, user_id=61c06d41d371486c9856a17c5b2aee20, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:39.806281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80784dda-d64b-4e87-b7fa-517ba8abdc46 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:39.876343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1213/2397] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:57:39 2022] PUT /identity/v3/projects/4c3ecf1efb8748a0af09e501e2b9d81b/users/61c06d41d371486c9856a17c5b2aee20/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:57:39.882504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377387d-f95f-4ccc-9070-786b511679a7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:39.882791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377387d-f95f-4ccc-9070-786b511679a7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:39.883095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377387d-f95f-4ccc-9070-786b511679a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:39.902379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5377387d-f95f-4ccc-9070-786b511679a7 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:57:39.904653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5377387d-f95f-4ccc-9070-786b511679a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:39.966627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1185/2398] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:57:39.976016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784dda-d64b-4e87-b7fa-517ba8abdc46 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:39.977750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-80784dda-d64b-4e87-b7fa-517ba8abdc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:39.992890 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:40.050659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80784dda-d64b-4e87-b7fa-517ba8abdc46 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:40.057280 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed1259-ed3e-425d-9e2a-267b8f9cb671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:40.058753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1259-ed3e-425d-9e2a-267b8f9cb671 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:40.059322 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1259-ed3e-425d-9e2a-267b8f9cb671 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:40.060005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed1259-ed3e-425d-9e2a-267b8f9cb671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:40.078461 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed1259-ed3e-425d-9e2a-267b8f9cb671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:40.081367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed1259-ed3e-425d-9e2a-267b8f9cb671 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:40.096339 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1214/2399] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:44.277351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a05b-d3d2-4ed8-ab8f-9a17220b990b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:44.277993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a05b-d3d2-4ed8-ab8f-9a17220b990b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:44.278890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0a05b-d3d2-4ed8-ab8f-9a17220b990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:44.299380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-74b0a05b-d3d2-4ed8-ab8f-9a17220b990b None None] MFA Rules not processed for user `01bb3df8b4b649388d1a0f6c24e18f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:57:44.302155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-74b0a05b-d3d2-4ed8-ab8f-9a17220b990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:44.347137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:44.389271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1186/2400] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:57:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:57:44.922544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed1259-ed3e-425d-9e2a-267b8f9cb671 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:44.936137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed1259-ed3e-425d-9e2a-267b8f9cb671 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:44.951166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6bd57-5749-447f-b130-8c122b7c8da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:44.951915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6bd57-5749-447f-b130-8c122b7c8da3 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:44.952205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6bd57-5749-447f-b130-8c122b7c8da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:44.953346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6bd57-5749-447f-b130-8c122b7c8da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:44.956969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2ea6bd57-5749-447f-b130-8c122b7c8da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:44.979127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6bd57-5749-447f-b130-8c122b7c8da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:44.981294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6bd57-5749-447f-b130-8c122b7c8da3 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:44.993665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1215/2401] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:45.734707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0a05b-d3d2-4ed8-ab8f-9a17220b990b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:45.734707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-74b0a05b-d3d2-4ed8-ab8f-9a17220b990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:45.879979 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0a05b-d3d2-4ed8-ab8f-9a17220b990b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:45.887180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e811f-d1b1-42e3-8bac-3cda60abb000 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:45.888211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e811f-d1b1-42e3-8bac-3cda60abb000 service placement] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:45.888711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e811f-d1b1-42e3-8bac-3cda60abb000 service placement] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:45.889088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e811f-d1b1-42e3-8bac-3cda60abb000 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:45.891681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0f9e811f-d1b1-42e3-8bac-3cda60abb000 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:45.909270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e811f-d1b1-42e3-8bac-3cda60abb000 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:45.914009 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e811f-d1b1-42e3-8bac-3cda60abb000 service placement] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:45.927862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1187/2402] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:46.559583 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737314-d54a-4bc6-9ad1-db005b0cc6a2 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:46.560544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737314-d54a-4bc6-9ad1-db005b0cc6a2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:46.561039 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737314-d54a-4bc6-9ad1-db005b0cc6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:46.612941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b4737314-d54a-4bc6-9ad1-db005b0cc6a2 None None] MFA Rules not processed for user `61c06d41d371486c9856a17c5b2aee20`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:57:46.614175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b4737314-d54a-4bc6-9ad1-db005b0cc6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:46.715836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1216/2403] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:57:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:57:46.720597 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e811f-d1b1-42e3-8bac-3cda60abb000 service placement] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:46.734648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e811f-d1b1-42e3-8bac-3cda60abb000 service placement] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:46.739862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9d34-0eda-494a-ac29-52b30dcc3d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:46.740661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9d34-0eda-494a-ac29-52b30dcc3d3a admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:46.741063 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9d34-0eda-494a-ac29-52b30dcc3d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:46.741404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a9d34-0eda-494a-ac29-52b30dcc3d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:46.742195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a9d34-0eda-494a-ac29-52b30dcc3d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:46.744296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a9d34-0eda-494a-ac29-52b30dcc3d3a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:46.868424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1188/2404] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:57:46 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:57:46.871321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737314-d54a-4bc6-9ad1-db005b0cc6a2 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:46.895105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737314-d54a-4bc6-9ad1-db005b0cc6a2 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:47.001130 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108e699-767a-40f6-b491-7f2841439464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:47.004367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e699-767a-40f6-b491-7f2841439464 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:47.004367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e699-767a-40f6-b491-7f2841439464 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:47.004367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e699-767a-40f6-b491-7f2841439464 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:47.004367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108e699-767a-40f6-b491-7f2841439464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:47.006149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108e699-767a-40f6-b491-7f2841439464 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:47.104262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1217/2405] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:57:46 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:57:47.105296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9d34-0eda-494a-ac29-52b30dcc3d3a admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:47.116379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a9d34-0eda-494a-ac29-52b30dcc3d3a admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:47.122493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9a8b8-f70c-47ca-ad93-10f68e33a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:47.123179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9a8b8-f70c-47ca-ad93-10f68e33a6ca admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:47.123400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9a8b8-f70c-47ca-ad93-10f68e33a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:47.123852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9a8b8-f70c-47ca-ad93-10f68e33a6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:47.124584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9a8b8-f70c-47ca-ad93-10f68e33a6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:47.126430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9a8b8-f70c-47ca-ad93-10f68e33a6ca admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:47.139521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1189/2406] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:57:47.144421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108e699-767a-40f6-b491-7f2841439464 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:47.155631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108e699-767a-40f6-b491-7f2841439464 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:47.161353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3786ae8-5eb5-4aff-97b9-2140cfa94760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:47.162368 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3786ae8-5eb5-4aff-97b9-2140cfa94760 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:47.162653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3786ae8-5eb5-4aff-97b9-2140cfa94760 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:47.162934 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3786ae8-5eb5-4aff-97b9-2140cfa94760 admin admin] PATH_INFO: `/v3/projects/4729c6eb33414711b24bb51b9a389fa5/users/108bb0a8cc5b444f9c742f5d7cad8546/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:47.180183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3786ae8-5eb5-4aff-97b9-2140cfa94760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4729c6eb33414711b24bb51b9a389fa5, user_id=108bb0a8cc5b444f9c742f5d7cad8546, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:47.183423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3786ae8-5eb5-4aff-97b9-2140cfa94760 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:47.288293 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:47.295309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1218/2407] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:57:47 2022] PUT /identity/v3/projects/4729c6eb33414711b24bb51b9a389fa5/users/108bb0a8cc5b444f9c742f5d7cad8546/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:57:47.299936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9a8b8-f70c-47ca-ad93-10f68e33a6ca admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:47.311965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9a8b8-f70c-47ca-ad93-10f68e33a6ca admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:47.379522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeac0f-c767-4786-a611-1291dbf86477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:47.380323 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeac0f-c767-4786-a611-1291dbf86477 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:47.380614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeac0f-c767-4786-a611-1291dbf86477 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:47.380893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeac0f-c767-4786-a611-1291dbf86477 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:47.381638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebeac0f-c767-4786-a611-1291dbf86477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:47.383471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebeac0f-c767-4786-a611-1291dbf86477 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:47.402747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1190/2408] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:57:47.403705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3786ae8-5eb5-4aff-97b9-2140cfa94760 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:47.415885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3786ae8-5eb5-4aff-97b9-2140cfa94760 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:47.420748 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c9dec-5fc5-4a11-a7d0-0bef82ff5b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:47.421606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c9dec-5fc5-4a11-a7d0-0bef82ff5b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:47.421920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c9dec-5fc5-4a11-a7d0-0bef82ff5b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:47.422197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c9dec-5fc5-4a11-a7d0-0bef82ff5b85 admin admin] PATH_INFO: `/v3/projects/4729c6eb33414711b24bb51b9a389fa5/users/108bb0a8cc5b444f9c742f5d7cad8546/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:47.424316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c9dec-5fc5-4a11-a7d0-0bef82ff5b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4729c6eb33414711b24bb51b9a389fa5, user_id=108bb0a8cc5b444f9c742f5d7cad8546, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:47.427064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c9dec-5fc5-4a11-a7d0-0bef82ff5b85 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:47.438250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1219/2409] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:57:47 2022] PUT /identity/v3/projects/4729c6eb33414711b24bb51b9a389fa5/users/108bb0a8cc5b444f9c742f5d7cad8546/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:57:49.496732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeac0f-c767-4786-a611-1291dbf86477 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:49.551861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:57:49.574198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeac0f-c767-4786-a611-1291dbf86477 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:49.635991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a7436-ed3a-4577-a93e-f787385d941f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:49.636831 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a7436-ed3a-4577-a93e-f787385d941f service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:49.637238 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a7436-ed3a-4577-a93e-f787385d941f service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:49.637621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a7436-ed3a-4577-a93e-f787385d941f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:49.640491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c51a7436-ed3a-4577-a93e-f787385d941f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:49.654024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a7436-ed3a-4577-a93e-f787385d941f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:49.655754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a7436-ed3a-4577-a93e-f787385d941f service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:49.667500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1191/2410] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:50.755743 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c9dec-5fc5-4a11-a7d0-0bef82ff5b85 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:50.760390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e20c9dec-5fc5-4a11-a7d0-0bef82ff5b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:50.862392 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c9dec-5fc5-4a11-a7d0-0bef82ff5b85 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:50.868988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc681c2-7748-403e-b86f-41f2d4d12762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:50.869808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc681c2-7748-403e-b86f-41f2d4d12762 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:50.870278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc681c2-7748-403e-b86f-41f2d4d12762 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:50.875391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc681c2-7748-403e-b86f-41f2d4d12762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:50.875391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9bc681c2-7748-403e-b86f-41f2d4d12762 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:50.891981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc681c2-7748-403e-b86f-41f2d4d12762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:50.893878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc681c2-7748-403e-b86f-41f2d4d12762 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:50.921045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1220/2411] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:57:56.614057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00340d0a-8e1a-454c-907c-33bd39cd711e None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:56.614550 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00340d0a-8e1a-454c-907c-33bd39cd711e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:56.614673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00340d0a-8e1a-454c-907c-33bd39cd711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:56.663727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-00340d0a-8e1a-454c-907c-33bd39cd711e None None] MFA Rules not processed for user `108bb0a8cc5b444f9c742f5d7cad8546`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:57:56.663727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-00340d0a-8e1a-454c-907c-33bd39cd711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:57:56.750936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1192/2412] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:57:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:57:56.764706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc681c2-7748-403e-b86f-41f2d4d12762 service nova] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:57:56.777279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc681c2-7748-403e-b86f-41f2d4d12762 service nova] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:57:56.784286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b4cde-d700-4975-8331-d58f718063ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:57:56.784948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b4cde-d700-4975-8331-d58f718063ea service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:57:56.785230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b4cde-d700-4975-8331-d58f718063ea service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:57:56.785526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b4cde-d700-4975-8331-d58f718063ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:57:56.847499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b4cde-d700-4975-8331-d58f718063ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:57:56.849142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b4cde-d700-4975-8331-d58f718063ea service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:57:56.859211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1221/2413] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:57:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:58:03.063062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00340d0a-8e1a-454c-907c-33bd39cd711e None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:03.076247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00340d0a-8e1a-454c-907c-33bd39cd711e None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:03.082673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6f430-3afb-4899-9da5-95554e9f0515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:03.083456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6f430-3afb-4899-9da5-95554e9f0515 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:03.083803 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6f430-3afb-4899-9da5-95554e9f0515 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:03.084301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6f430-3afb-4899-9da5-95554e9f0515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:03.086261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-46c6f430-3afb-4899-9da5-95554e9f0515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:03.100286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6f430-3afb-4899-9da5-95554e9f0515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:03.101965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6f430-3afb-4899-9da5-95554e9f0515 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:03.114604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1193/2414] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:58:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:58:03.744914 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b536f3-ab7b-4da8-85ba-14be94a3018a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:03.745513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b536f3-ab7b-4da8-85ba-14be94a3018a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:03.745513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b536f3-ab7b-4da8-85ba-14be94a3018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:03.766722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f6b536f3-ab7b-4da8-85ba-14be94a3018a None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:03.768916 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f6b536f3-ab7b-4da8-85ba-14be94a3018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:03.853049 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1222/2415] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:58:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:03.869311 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6f430-3afb-4899-9da5-95554e9f0515 service nova] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:03.871640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-46c6f430-3afb-4899-9da5-95554e9f0515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:03.954498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6f430-3afb-4899-9da5-95554e9f0515 service nova] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:03.962962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db606add-43cc-40cb-a694-cc6740f4eb2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:03.962962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db606add-43cc-40cb-a694-cc6740f4eb2b service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:03.962962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db606add-43cc-40cb-a694-cc6740f4eb2b service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:03.962962 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db606add-43cc-40cb-a694-cc6740f4eb2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:03.977169 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db606add-43cc-40cb-a694-cc6740f4eb2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:03.979090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db606add-43cc-40cb-a694-cc6740f4eb2b service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:03.983617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:03.991570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1194/2416] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:58:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:58:13.997360 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:14.029371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:14.947199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b536f3-ab7b-4da8-85ba-14be94a3018a None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:14.960605 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b536f3-ab7b-4da8-85ba-14be94a3018a None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:14.966049 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e02691-f253-4d82-b02e-fbffbe3a62b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:14.966702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02691-f253-4d82-b02e-fbffbe3a62b1 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:14.966987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02691-f253-4d82-b02e-fbffbe3a62b1 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:14.967266 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02691-f253-4d82-b02e-fbffbe3a62b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:14.969270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-11e02691-f253-4d82-b02e-fbffbe3a62b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:15.029520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02691-f253-4d82-b02e-fbffbe3a62b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:15.031134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02691-f253-4d82-b02e-fbffbe3a62b1 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:15.042544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1223/2417] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:58:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:58:18.180148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ced5c-162c-4ff8-842c-c3659dc8b5f6 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:18.180697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ced5c-162c-4ff8-842c-c3659dc8b5f6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:18.180783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ced5c-162c-4ff8-842c-c3659dc8b5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:18.201611 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-749ced5c-162c-4ff8-842c-c3659dc8b5f6 None None] MFA Rules not processed for user `61c06d41d371486c9856a17c5b2aee20`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:18.202943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-749ced5c-162c-4ff8-842c-c3659dc8b5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:18.214408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1195/2418] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:58:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:25.037610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=28 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:28.196335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:28.905979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14027a1-76af-4cf2-bcef-72ad3eceb63d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:28.907022 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14027a1-76af-4cf2-bcef-72ad3eceb63d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:28.907509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14027a1-76af-4cf2-bcef-72ad3eceb63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:28.930542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-c14027a1-76af-4cf2-bcef-72ad3eceb63d None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:28.932128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c14027a1-76af-4cf2-bcef-72ad3eceb63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:28.940703 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1224/2419] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 08:58:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:28.963724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ced5c-162c-4ff8-842c-c3659dc8b5f6 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:28.979568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ced5c-162c-4ff8-842c-c3659dc8b5f6 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:28.992721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d05b2-f2bc-410f-9eab-a406b42def02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:28.992721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d05b2-f2bc-410f-9eab-a406b42def02 service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:28.992721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d05b2-f2bc-410f-9eab-a406b42def02 service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:28.992721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d05b2-f2bc-410f-9eab-a406b42def02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:29.002028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d05b2-f2bc-410f-9eab-a406b42def02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:29.003970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d05b2-f2bc-410f-9eab-a406b42def02 service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:29.017384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1196/2420] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:58:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:58:38.923990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:39.012491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=6 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:45.907726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14027a1-76af-4cf2-bcef-72ad3eceb63d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:45.909121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c14027a1-76af-4cf2-bcef-72ad3eceb63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:45.920795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14027a1-76af-4cf2-bcef-72ad3eceb63d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:45.925443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9167b39-0eda-4eaa-8fed-048c624fb43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:45.930168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9167b39-0eda-4eaa-8fed-048c624fb43a service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:45.930168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9167b39-0eda-4eaa-8fed-048c624fb43a service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:45.930168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9167b39-0eda-4eaa-8fed-048c624fb43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:45.937429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9167b39-0eda-4eaa-8fed-048c624fb43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:45.939928 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9167b39-0eda-4eaa-8fed-048c624fb43a service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:45.950188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1225/2421] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:58:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:58:47.294484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d05b2-f2bc-410f-9eab-a406b42def02 service swift] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:47.305053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d05b2-f2bc-410f-9eab-a406b42def02 service swift] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:47.309699 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d71b36-dab2-4061-bb9a-d537cac2e3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:47.310639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d71b36-dab2-4061-bb9a-d537cac2e3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:47.310919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d71b36-dab2-4061-bb9a-d537cac2e3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:47.311511 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d71b36-dab2-4061-bb9a-d537cac2e3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:47.313983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c3d71b36-dab2-4061-bb9a-d537cac2e3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:47.413108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d71b36-dab2-4061-bb9a-d537cac2e3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:47.414587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d71b36-dab2-4061-bb9a-d537cac2e3f9 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:47.426223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1197/2422] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:58:48.152091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d83eca-09dd-4a1a-b7d6-d0d22f5bf84b None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:48.152692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d83eca-09dd-4a1a-b7d6-d0d22f5bf84b None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:48.152692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d83eca-09dd-4a1a-b7d6-d0d22f5bf84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:48.171451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-f6d83eca-09dd-4a1a-b7d6-d0d22f5bf84b None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:48.173196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f6d83eca-09dd-4a1a-b7d6-d0d22f5bf84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:48.180375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1226/2423] 10.222.0.78 () {58 vars in 967 bytes} [Fri Jun 17 08:58:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:48.195730 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d71b36-dab2-4061-bb9a-d537cac2e3f9 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:48.207923 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d71b36-dab2-4061-bb9a-d537cac2e3f9 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:48.213050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecc146-c4b0-4d03-994d-27e556bd9177 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:48.213713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecc146-c4b0-4d03-994d-27e556bd9177 service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:48.213998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecc146-c4b0-4d03-994d-27e556bd9177 service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:48.214276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecc146-c4b0-4d03-994d-27e556bd9177 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:48.223838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecc146-c4b0-4d03-994d-27e556bd9177 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:48.225460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecc146-c4b0-4d03-994d-27e556bd9177 service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:48.235427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1198/2424] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 08:58:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 08:58:52.212756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d83eca-09dd-4a1a-b7d6-d0d22f5bf84b None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:52.214722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f6d83eca-09dd-4a1a-b7d6-d0d22f5bf84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:52.291004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d83eca-09dd-4a1a-b7d6-d0d22f5bf84b None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:52.296052 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898dc5-79b4-4c05-bb15-f9f08691a41f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:52.296704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898dc5-79b4-4c05-bb15-f9f08691a41f service placement] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:52.296993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898dc5-79b4-4c05-bb15-f9f08691a41f service placement] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:52.297961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898dc5-79b4-4c05-bb15-f9f08691a41f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:52.299801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-23898dc5-79b4-4c05-bb15-f9f08691a41f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:52.311665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23898dc5-79b4-4c05-bb15-f9f08691a41f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:52.313254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23898dc5-79b4-4c05-bb15-f9f08691a41f service placement] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:52.323508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1227/2425] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:58:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:58:52.354317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecc146-c4b0-4d03-994d-27e556bd9177 service swift] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:52.356507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3fecc146-c4b0-4d03-994d-27e556bd9177 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:52.378568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecc146-c4b0-4d03-994d-27e556bd9177 service swift] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:52.383128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:52.384025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:52.384302 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:52.384571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] PATH_INFO: `/v3/users/5e4214dbd10d491eb6afa50321edca88` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:52.385769 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4214dbd10d491eb6afa50321edca88)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:52.387775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:52.620186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4214dbd10d491eb6afa50321edca88'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:52.627221 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4214dbd10d491eb6afa50321edca88'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:52.755724 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4214dbd10d491eb6afa50321edca88'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:52.756371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4214dbd10d491eb6afa50321edca88'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:52.757206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-4823bc4c-09ce-41dc-9ef8-ebcf83ddb1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4214dbd10d491eb6afa50321edca88'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:52.778789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1199/2426] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:58:52 2022] DELETE /identity/v3/users/5e4214dbd10d491eb6afa50321edca88 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:53.042701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898dc5-79b4-4c05-bb15-f9f08691a41f service placement] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:53.061975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898dc5-79b4-4c05-bb15-f9f08691a41f service placement] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:53.116142 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:53.117043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:53.117323 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:53.117600 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] PATH_INFO: `/v3/projects/6cd5b6aa6edd4bafa8aec3e9d28ae980` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:53.118788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd5b6aa6edd4bafa8aec3e9d28ae980)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:53.120746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:53.241806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'request_id': 'req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:53.247973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'request_id': 'req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:53.254352 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd5b6aa6edd4bafa8aec3e9d28ae980', 'request_id': 'req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:53.385136 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:53.389009 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] The token cache is being invalidate because project 6cd5b6aa6edd4bafa8aec3e9d28ae980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:58:53.389335 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:53.396235 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-4edeefd2-e6ba-4767-8723-6ddf0ba2f979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:53.396235 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1228/2427] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:58:53 2022] DELETE /identity/v3/projects/6cd5b6aa6edd4bafa8aec3e9d28ae980 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:53.402402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66fcb0-d648-4397-96fa-fc04b3157c78 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:53.402890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66fcb0-d648-4397-96fa-fc04b3157c78 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:53.402986 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66fcb0-d648-4397-96fa-fc04b3157c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:53.422865 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-0e66fcb0-d648-4397-96fa-fc04b3157c78 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:53.424126 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0e66fcb0-d648-4397-96fa-fc04b3157c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:53.474504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:53.486906 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1200/2428] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:53.494875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ce900-1ced-4785-b102-c3ffb091c353 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:53.495161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ce900-1ced-4785-b102-c3ffb091c353 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:53.495476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ce900-1ced-4785-b102-c3ffb091c353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:53.513943 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-423ce900-1ced-4785-b102-c3ffb091c353 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:53.515214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-423ce900-1ced-4785-b102-c3ffb091c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:53.528867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1229/2429] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:53.530186 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66fcb0-d648-4397-96fa-fc04b3157c78 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:53.541029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66fcb0-d648-4397-96fa-fc04b3157c78 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:53.545662 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7fa00-7545-4dd4-9b50-db3df2305ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:53.546344 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7fa00-7545-4dd4-9b50-db3df2305ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:53.546626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7fa00-7545-4dd4-9b50-db3df2305ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:53.546903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7fa00-7545-4dd4-9b50-db3df2305ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:53.547869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7fa00-7545-4dd4-9b50-db3df2305ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:58:53.548175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7fa00-7545-4dd4-9b50-db3df2305ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:53.549778 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7fa00-7545-4dd4-9b50-db3df2305ba9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:53.563382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1201/2430] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:58:53.567034 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ce900-1ced-4785-b102-c3ffb091c353 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:53.577074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ce900-1ced-4785-b102-c3ffb091c353 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:53.582291 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba69df1-0722-4e5d-bcd1-82f3680fcfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:53.582945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba69df1-0722-4e5d-bcd1-82f3680fcfa2 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:53.583231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba69df1-0722-4e5d-bcd1-82f3680fcfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:53.583538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba69df1-0722-4e5d-bcd1-82f3680fcfa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:53.584233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba69df1-0722-4e5d-bcd1-82f3680fcfa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:53.586130 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba69df1-0722-4e5d-bcd1-82f3680fcfa2 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:53.682676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1230/2431] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:58:53 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:58:53.686834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7fa00-7545-4dd4-9b50-db3df2305ba9 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:53.697484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7fa00-7545-4dd4-9b50-db3df2305ba9 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:53.752951 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bcdfe-1d1b-452b-84bc-6e76b09568aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:53.753669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bcdfe-1d1b-452b-84bc-6e76b09568aa admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:53.753947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bcdfe-1d1b-452b-84bc-6e76b09568aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:53.754221 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bcdfe-1d1b-452b-84bc-6e76b09568aa admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:53.754901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bcdfe-1d1b-452b-84bc-6e76b09568aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:53.757002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bcdfe-1d1b-452b-84bc-6e76b09568aa admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:53.865443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1202/2432] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:58:53 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:58:53.870856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba69df1-0722-4e5d-bcd1-82f3680fcfa2 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:53.882161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba69df1-0722-4e5d-bcd1-82f3680fcfa2 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:53.886832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160a01f-e0b6-4eb5-8fbf-9c28c9daac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:53.887531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160a01f-e0b6-4eb5-8fbf-9c28c9daac61 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:53.887817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160a01f-e0b6-4eb5-8fbf-9c28c9daac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:53.888092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160a01f-e0b6-4eb5-8fbf-9c28c9daac61 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:53.888877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160a01f-e0b6-4eb5-8fbf-9c28c9daac61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:53.890478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160a01f-e0b6-4eb5-8fbf-9c28c9daac61 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:53.901483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1231/2433] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:58:53.905466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bcdfe-1d1b-452b-84bc-6e76b09568aa admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:53.916689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bcdfe-1d1b-452b-84bc-6e76b09568aa admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:53.921831 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2acd5-7129-4934-9d07-1effada7807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:53.922970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2acd5-7129-4934-9d07-1effada7807a admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:53.923404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2acd5-7129-4934-9d07-1effada7807a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:53.923695 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2acd5-7129-4934-9d07-1effada7807a admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:53.924442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2acd5-7129-4934-9d07-1effada7807a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:53.926107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2acd5-7129-4934-9d07-1effada7807a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:53.938197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1203/2434] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:58:53.942479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160a01f-e0b6-4eb5-8fbf-9c28c9daac61 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:53.952602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160a01f-e0b6-4eb5-8fbf-9c28c9daac61 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:53.958278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066730ce-4983-4e00-b4ca-d51ab287fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:53.959282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066730ce-4983-4e00-b4ca-d51ab287fac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:53.959669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066730ce-4983-4e00-b4ca-d51ab287fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:53.959988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066730ce-4983-4e00-b4ca-d51ab287fac1 admin admin] PATH_INFO: `/v3/projects/5bdaf9e30b2e4dab84be8af29afe274e/users/3e3680334c554bf1b33d23b04694d8f2/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:53.975012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066730ce-4983-4e00-b4ca-d51ab287fac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdaf9e30b2e4dab84be8af29afe274e, user_id=3e3680334c554bf1b33d23b04694d8f2, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:53.977708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066730ce-4983-4e00-b4ca-d51ab287fac1 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:54.057965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1232/2435] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:58:53 2022] PUT /identity/v3/projects/5bdaf9e30b2e4dab84be8af29afe274e/users/3e3680334c554bf1b33d23b04694d8f2/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:54.069608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031b36-f236-44ff-9e63-f081964b6e56 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:54.070021 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031b36-f236-44ff-9e63-f081964b6e56 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:54.070311 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64031b36-f236-44ff-9e63-f081964b6e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:54.098163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-64031b36-f236-44ff-9e63-f081964b6e56 None None] MFA Rules not processed for user `3e3680334c554bf1b33d23b04694d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:54.099382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-64031b36-f236-44ff-9e63-f081964b6e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:54.163443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1204/2436] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:58:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:58:54.167968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066730ce-4983-4e00-b4ca-d51ab287fac1 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:54.229996 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066730ce-4983-4e00-b4ca-d51ab287fac1 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:54.235270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef6d67-460b-446b-80de-2978179a6940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:54.235964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef6d67-460b-446b-80de-2978179a6940 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:54.236246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef6d67-460b-446b-80de-2978179a6940 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:54.236553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef6d67-460b-446b-80de-2978179a6940 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:54.237248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef6d67-460b-446b-80de-2978179a6940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:54.239166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef6d67-460b-446b-80de-2978179a6940 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:54.339524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1233/2437] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:58:54 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:58:54.343714 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64031b36-f236-44ff-9e63-f081964b6e56 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:54.355317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64031b36-f236-44ff-9e63-f081964b6e56 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:54.400020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:54.412355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba843a6-053e-4932-a70c-36748687f507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:54.413052 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba843a6-053e-4932-a70c-36748687f507 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:54.413338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba843a6-053e-4932-a70c-36748687f507 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:54.413615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba843a6-053e-4932-a70c-36748687f507 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:54.414309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba843a6-053e-4932-a70c-36748687f507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:54.416345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba843a6-053e-4932-a70c-36748687f507 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:54.543644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1205/2438] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:58:54 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:58:54.548480 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef6d67-460b-446b-80de-2978179a6940 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:54.559075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef6d67-460b-446b-80de-2978179a6940 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:54.564521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3f79f-039e-47bf-afed-f475c496540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:54.564521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f79f-039e-47bf-afed-f475c496540f admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:54.564750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f79f-039e-47bf-afed-f475c496540f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:54.565017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f79f-039e-47bf-afed-f475c496540f admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:54.565772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3f79f-039e-47bf-afed-f475c496540f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:54.567372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3f79f-039e-47bf-afed-f475c496540f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:54.578879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1234/2439] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:58:54.583403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba843a6-053e-4932-a70c-36748687f507 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:54.593666 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba843a6-053e-4932-a70c-36748687f507 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:54.599225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc576d5-ef13-403f-a0e0-a5aaf7f9d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:54.600146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc576d5-ef13-403f-a0e0-a5aaf7f9d265 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:54.600433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc576d5-ef13-403f-a0e0-a5aaf7f9d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:54.600710 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc576d5-ef13-403f-a0e0-a5aaf7f9d265 admin admin] PATH_INFO: `/v3/projects/aa88285961db48df94b37d9b51073276/users/d3aef997dad54bf38af6e850413d666c/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:54.617218 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc576d5-ef13-403f-a0e0-a5aaf7f9d265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa88285961db48df94b37d9b51073276, user_id=d3aef997dad54bf38af6e850413d666c, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:54.619971 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc576d5-ef13-403f-a0e0-a5aaf7f9d265 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:54.727445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1206/2440] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:58:54 2022] PUT /identity/v3/projects/aa88285961db48df94b37d9b51073276/users/d3aef997dad54bf38af6e850413d666c/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:54.731570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3f79f-039e-47bf-afed-f475c496540f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:54.742468 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3f79f-039e-47bf-afed-f475c496540f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:54.802416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990737b-7137-49ed-94bc-c5e0606bd373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:54.803038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990737b-7137-49ed-94bc-c5e0606bd373 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:54.803319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990737b-7137-49ed-94bc-c5e0606bd373 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:54.803695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990737b-7137-49ed-94bc-c5e0606bd373 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:54.804425 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990737b-7137-49ed-94bc-c5e0606bd373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:54.806431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990737b-7137-49ed-94bc-c5e0606bd373 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:54.808737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:54.817347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1235/2441] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:58:54.821626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc576d5-ef13-403f-a0e0-a5aaf7f9d265 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:54.832779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc576d5-ef13-403f-a0e0-a5aaf7f9d265 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:54.837682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78877192-89c0-47db-a61e-6cdd2bc6e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:54.838572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78877192-89c0-47db-a61e-6cdd2bc6e29e admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:54.838861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78877192-89c0-47db-a61e-6cdd2bc6e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:54.839140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78877192-89c0-47db-a61e-6cdd2bc6e29e admin admin] PATH_INFO: `/v3/projects/aa88285961db48df94b37d9b51073276/users/d3aef997dad54bf38af6e850413d666c/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:54.841139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78877192-89c0-47db-a61e-6cdd2bc6e29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa88285961db48df94b37d9b51073276, user_id=d3aef997dad54bf38af6e850413d666c, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:54.843839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78877192-89c0-47db-a61e-6cdd2bc6e29e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:54.855231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1207/2442] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:58:54 2022] PUT /identity/v3/projects/aa88285961db48df94b37d9b51073276/users/d3aef997dad54bf38af6e850413d666c/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:54.869139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9846c5-7a8e-4d60-a4dc-3b43e264b92f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:54.870049 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9846c5-7a8e-4d60-a4dc-3b43e264b92f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:54.870532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9846c5-7a8e-4d60-a4dc-3b43e264b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:54.907767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-cb9846c5-7a8e-4d60-a4dc-3b43e264b92f None None] MFA Rules not processed for user `d3aef997dad54bf38af6e850413d666c`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:54.907767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-cb9846c5-7a8e-4d60-a4dc-3b43e264b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:54.981692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1236/2443] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:58:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:54.993266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78877192-89c0-47db-a61e-6cdd2bc6e29e admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:54.994958 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-78877192-89c0-47db-a61e-6cdd2bc6e29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:55.062717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78877192-89c0-47db-a61e-6cdd2bc6e29e admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:55.066329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6157c-bc61-4e34-a855-7d0dc4940246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:55.066975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6157c-bc61-4e34-a855-7d0dc4940246 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:55.067259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6157c-bc61-4e34-a855-7d0dc4940246 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:55.067564 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6157c-bc61-4e34-a855-7d0dc4940246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:55.076745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6157c-bc61-4e34-a855-7d0dc4940246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:55.078684 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6157c-bc61-4e34-a855-7d0dc4940246 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:55.088391 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1208/2444] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:58:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:58:56.120453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9846c5-7a8e-4d60-a4dc-3b43e264b92f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:56.183460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9846c5-7a8e-4d60-a4dc-3b43e264b92f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:56.188025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:56.188959 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:56.189186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:56.189465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] PATH_INFO: `/v3/users/3e3680334c554bf1b33d23b04694d8f2` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:56.190692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3680334c554bf1b33d23b04694d8f2)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:56.192682 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:56.398405 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3680334c554bf1b33d23b04694d8f2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:56.412124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3680334c554bf1b33d23b04694d8f2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:56.509456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3680334c554bf1b33d23b04694d8f2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:56.518115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3680334c554bf1b33d23b04694d8f2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:56.518788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3680334c554bf1b33d23b04694d8f2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:56.524787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1237/2445] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:58:56 2022] DELETE /identity/v3/users/3e3680334c554bf1b33d23b04694d8f2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:56.529286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86dfe0-d640-46fe-b139-ee128ff28238 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:56.529777 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86dfe0-d640-46fe-b139-ee128ff28238 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:56.529873 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86dfe0-d640-46fe-b139-ee128ff28238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:56.549839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8c86dfe0-d640-46fe-b139-ee128ff28238 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:56.551495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8c86dfe0-d640-46fe-b139-ee128ff28238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:56.616101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1209/2446] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:56.627320 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:56.628983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:56.634566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:56.689419 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3a6c-cfab-4f97-8c66-d85880e1dc4a admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:56.693148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33567ca9-792c-49c9-a1d4-463037faadef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:56.693801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567ca9-792c-49c9-a1d4-463037faadef service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:56.694084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567ca9-792c-49c9-a1d4-463037faadef service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:56.694361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33567ca9-792c-49c9-a1d4-463037faadef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:56.705668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33567ca9-792c-49c9-a1d4-463037faadef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:56.705668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33567ca9-792c-49c9-a1d4-463037faadef service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:56.715063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1238/2447] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:58:57.168299 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86dfe0-d640-46fe-b139-ee128ff28238 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:57.169897 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8c86dfe0-d640-46fe-b139-ee128ff28238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:57.193741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86dfe0-d640-46fe-b139-ee128ff28238 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:57.199716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:57.200836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:57.201301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:57.201741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] PATH_INFO: `/v3/projects/5bdaf9e30b2e4dab84be8af29afe274e` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:57.203741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bdaf9e30b2e4dab84be8af29afe274e)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:57.206117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:57.338987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:57.346604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bdaf9e30b2e4dab84be8af29afe274e', 'request_id': 'req-05256606-24b6-4921-828c-a1d49d60d7e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:57.352976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bdaf9e30b2e4dab84be8af29afe274e', 'request_id': 'req-05256606-24b6-4921-828c-a1d49d60d7e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:57.358338 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bdaf9e30b2e4dab84be8af29afe274e', 'request_id': 'req-05256606-24b6-4921-828c-a1d49d60d7e0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:57.440272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] The token cache is being invalidate because project 5bdaf9e30b2e4dab84be8af29afe274e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:58:57.440558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:57.441174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:57.442751 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1210/2448] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:58:57 2022] DELETE /identity/v3/projects/5bdaf9e30b2e4dab84be8af29afe274e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:57.447062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33567ca9-792c-49c9-a1d4-463037faadef service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:57.458191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33567ca9-792c-49c9-a1d4-463037faadef service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:57.531762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:57.532857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:57.533286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:57.533667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] PATH_INFO: `/v3/users/d3aef997dad54bf38af6e850413d666c` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:57.535594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3aef997dad54bf38af6e850413d666c)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:57.539096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:57.769173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3aef997dad54bf38af6e850413d666c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:57.781285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3aef997dad54bf38af6e850413d666c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:57.869206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3aef997dad54bf38af6e850413d666c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:57.877694 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3aef997dad54bf38af6e850413d666c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:57.878338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cbafce96-5507-4451-9de8-db60a7a77e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3aef997dad54bf38af6e850413d666c'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:57.884596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1239/2449] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:58:57 2022] DELETE /identity/v3/users/d3aef997dad54bf38af6e850413d666c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:58.352392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:58.353852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:58.369871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05256606-24b6-4921-828c-a1d49d60d7e0 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:58.432656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:58.433522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:58.433801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:58.434073 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] PATH_INFO: `/v3/projects/aa88285961db48df94b37d9b51073276` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:58.435246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa88285961db48df94b37d9b51073276)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:58.437198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:58.608429 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa88285961db48df94b37d9b51073276', 'request_id': 'req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:58.615749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa88285961db48df94b37d9b51073276', 'request_id': 'req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:58.624202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa88285961db48df94b37d9b51073276', 'request_id': 'req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:58.704054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] The token cache is being invalidate because project aa88285961db48df94b37d9b51073276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:58:58.704370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:58.705030 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2c0161f4-aa7d-4b34-bc49-99ac670c4b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:58:58.706610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1211/2450] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:58:58 2022] DELETE /identity/v3/projects/aa88285961db48df94b37d9b51073276 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:58.711713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2df6-1eea-4f45-9954-c301bdacc238 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:58.712222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2df6-1eea-4f45-9954-c301bdacc238 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:58.712334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2df6-1eea-4f45-9954-c301bdacc238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:58.731527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a0db2df6-1eea-4f45-9954-c301bdacc238 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:58.732776 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a0db2df6-1eea-4f45-9954-c301bdacc238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:58.752057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:58.793336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1240/2451] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:58.801195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae106a-0678-4d3f-8d7d-5b6f399467ab None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:58.801488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae106a-0678-4d3f-8d7d-5b6f399467ab None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:58.801787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae106a-0678-4d3f-8d7d-5b6f399467ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:58.820151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-e4ae106a-0678-4d3f-8d7d-5b6f399467ab None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:58.821351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e4ae106a-0678-4d3f-8d7d-5b6f399467ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:58.830192 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1212/2452] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:58.834457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db2df6-1eea-4f45-9954-c301bdacc238 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:58.845453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db2df6-1eea-4f45-9954-c301bdacc238 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:58.850092 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6645-c3a3-41ba-aa39-0d85ca56ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:58.850746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6645-c3a3-41ba-aa39-0d85ca56ba1e admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:58.851062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6645-c3a3-41ba-aa39-0d85ca56ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:58.851364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6645-c3a3-41ba-aa39-0d85ca56ba1e admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:58.852094 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c6645-c3a3-41ba-aa39-0d85ca56ba1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:58:58.852404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c6645-c3a3-41ba-aa39-0d85ca56ba1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:58.854002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c6645-c3a3-41ba-aa39-0d85ca56ba1e admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:58.865646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1241/2453] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:58:58.869929 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae106a-0678-4d3f-8d7d-5b6f399467ab None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:58.879810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae106a-0678-4d3f-8d7d-5b6f399467ab None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:58.884490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47651f2-087b-4173-84dd-b788aa483ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:58.885147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47651f2-087b-4173-84dd-b788aa483ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:58.886084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47651f2-087b-4173-84dd-b788aa483ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:58.886375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47651f2-087b-4173-84dd-b788aa483ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:58.887064 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47651f2-087b-4173-84dd-b788aa483ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:58.889062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47651f2-087b-4173-84dd-b788aa483ff7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:58.974259 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1213/2454] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:58:58 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:58:58.978528 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6645-c3a3-41ba-aa39-0d85ca56ba1e admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:58.988850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6645-c3a3-41ba-aa39-0d85ca56ba1e admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:59.045857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8ef5-3868-4d2d-a1c5-6069036b96c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:59.046525 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8ef5-3868-4d2d-a1c5-6069036b96c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:59.046883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8ef5-3868-4d2d-a1c5-6069036b96c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:59.047161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8ef5-3868-4d2d-a1c5-6069036b96c7 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:59.047935 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea8ef5-3868-4d2d-a1c5-6069036b96c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:59.049853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea8ef5-3868-4d2d-a1c5-6069036b96c7 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:59.133829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1242/2455] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:58:58 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:58:59.138072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47651f2-087b-4173-84dd-b788aa483ff7 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:59.149749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47651f2-087b-4173-84dd-b788aa483ff7 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:59.154658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195f558-1ed0-4817-b5c7-d938da99fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:59.155324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195f558-1ed0-4817-b5c7-d938da99fbcd admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:59.155641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195f558-1ed0-4817-b5c7-d938da99fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:59.155951 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195f558-1ed0-4817-b5c7-d938da99fbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:59.156853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195f558-1ed0-4817-b5c7-d938da99fbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:59.158732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195f558-1ed0-4817-b5c7-d938da99fbcd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:59.169830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1214/2456] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:58:59.174030 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8ef5-3868-4d2d-a1c5-6069036b96c7 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:59.184414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8ef5-3868-4d2d-a1c5-6069036b96c7 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:59.189825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85c2e0-b1f8-4f97-b0df-536b7ce37617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:59.190479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85c2e0-b1f8-4f97-b0df-536b7ce37617 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:59.190762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85c2e0-b1f8-4f97-b0df-536b7ce37617 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:59.191039 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85c2e0-b1f8-4f97-b0df-536b7ce37617 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:59.191794 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85c2e0-b1f8-4f97-b0df-536b7ce37617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:59.193422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85c2e0-b1f8-4f97-b0df-536b7ce37617 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:59.204290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1243/2457] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:58:59.208516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195f558-1ed0-4817-b5c7-d938da99fbcd admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:59.218468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195f558-1ed0-4817-b5c7-d938da99fbcd admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:59.223184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67206df4-cb48-4049-9879-d0b43d48a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:59.224096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67206df4-cb48-4049-9879-d0b43d48a39f admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:59.224383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67206df4-cb48-4049-9879-d0b43d48a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:59.224659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67206df4-cb48-4049-9879-d0b43d48a39f admin admin] PATH_INFO: `/v3/projects/f7707223cebb4947982cdcd0047c3031/users/922c9358fb9c4cae8f27cab8e967f132/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:59.239975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67206df4-cb48-4049-9879-d0b43d48a39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7707223cebb4947982cdcd0047c3031, user_id=922c9358fb9c4cae8f27cab8e967f132, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:59.242586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67206df4-cb48-4049-9879-d0b43d48a39f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:59.244781 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:59.309262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1215/2458] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:58:59 2022] PUT /identity/v3/projects/f7707223cebb4947982cdcd0047c3031/users/922c9358fb9c4cae8f27cab8e967f132/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:59.321269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed5d9c-c1f1-43ec-b7c2-81c7362c1ee4 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:59.321706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed5d9c-c1f1-43ec-b7c2-81c7362c1ee4 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:59.321881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed5d9c-c1f1-43ec-b7c2-81c7362c1ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:59.348773 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-90ed5d9c-c1f1-43ec-b7c2-81c7362c1ee4 None None] MFA Rules not processed for user `922c9358fb9c4cae8f27cab8e967f132`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:58:59.349987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-90ed5d9c-c1f1-43ec-b7c2-81c7362c1ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:58:59.414308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1244/2459] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:58:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:58:59.418933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67206df4-cb48-4049-9879-d0b43d48a39f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:59.482706 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67206df4-cb48-4049-9879-d0b43d48a39f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:59.488144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2389e40-0ae9-4bc9-a335-0d2072dbc1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:59.488806 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2389e40-0ae9-4bc9-a335-0d2072dbc1cd admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:59.489092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2389e40-0ae9-4bc9-a335-0d2072dbc1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:59.489370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2389e40-0ae9-4bc9-a335-0d2072dbc1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:59.490060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2389e40-0ae9-4bc9-a335-0d2072dbc1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:59.492032 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2389e40-0ae9-4bc9-a335-0d2072dbc1cd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:59.573414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1216/2460] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:58:59 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:58:59.577534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed5d9c-c1f1-43ec-b7c2-81c7362c1ee4 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:59.588769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed5d9c-c1f1-43ec-b7c2-81c7362c1ee4 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:59.605862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:58:59.647286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc99e05-3b9e-4492-b993-35cda723f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:59.647998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc99e05-3b9e-4492-b993-35cda723f587 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:59.648282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc99e05-3b9e-4492-b993-35cda723f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:59.648587 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc99e05-3b9e-4492-b993-35cda723f587 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:59.649346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc99e05-3b9e-4492-b993-35cda723f587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:59.651305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc99e05-3b9e-4492-b993-35cda723f587 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:59.748605 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1245/2461] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:58:59 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:58:59.749847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2389e40-0ae9-4bc9-a335-0d2072dbc1cd admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:59.761036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2389e40-0ae9-4bc9-a335-0d2072dbc1cd admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:59.765895 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7a480-8d52-4bd1-a9b7-7f43795645dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:59.766566 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7a480-8d52-4bd1-a9b7-7f43795645dd admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:59.766859 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7a480-8d52-4bd1-a9b7-7f43795645dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:59.767119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7a480-8d52-4bd1-a9b7-7f43795645dd admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:59.767879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7a480-8d52-4bd1-a9b7-7f43795645dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:59.769479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7a480-8d52-4bd1-a9b7-7f43795645dd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:59.780614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1217/2462] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:58:59.785202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc99e05-3b9e-4492-b993-35cda723f587 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:59.795517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc99e05-3b9e-4492-b993-35cda723f587 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:59.801365 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318767cb-1a57-4903-9f7e-5201099690c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:59.802296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318767cb-1a57-4903-9f7e-5201099690c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:59.802719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318767cb-1a57-4903-9f7e-5201099690c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:59.803006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318767cb-1a57-4903-9f7e-5201099690c9 admin admin] PATH_INFO: `/v3/projects/faae43f959a545e38667858c6f413aa7/users/ad553400204a4ce78106ac6fa04f9e3a/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:59.818728 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318767cb-1a57-4903-9f7e-5201099690c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faae43f959a545e38667858c6f413aa7, user_id=ad553400204a4ce78106ac6fa04f9e3a, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:59.821424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318767cb-1a57-4903-9f7e-5201099690c9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:58:59.914653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1246/2463] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:58:59 2022] PUT /identity/v3/projects/faae43f959a545e38667858c6f413aa7/users/ad553400204a4ce78106ac6fa04f9e3a/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:58:59.918880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7a480-8d52-4bd1-a9b7-7f43795645dd admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:58:59.929958 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7a480-8d52-4bd1-a9b7-7f43795645dd admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:58:59.988030 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341081f-abba-405e-ad4f-3f0b6dedd82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:58:59.988707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341081f-abba-405e-ad4f-3f0b6dedd82c admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:58:59.988986 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341081f-abba-405e-ad4f-3f0b6dedd82c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:58:59.989260 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341081f-abba-405e-ad4f-3f0b6dedd82c admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:58:59.989974 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341081f-abba-405e-ad4f-3f0b6dedd82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:58:59.991587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341081f-abba-405e-ad4f-3f0b6dedd82c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:00.002726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1218/2464] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:00.007013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318767cb-1a57-4903-9f7e-5201099690c9 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:00.018351 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318767cb-1a57-4903-9f7e-5201099690c9 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:00.023271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4cc79-a606-4c28-8da7-edae4d4ec5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:00.024236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cc79-a606-4c28-8da7-edae4d4ec5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:00.024520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cc79-a606-4c28-8da7-edae4d4ec5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:00.024797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cc79-a606-4c28-8da7-edae4d4ec5e4 admin admin] PATH_INFO: `/v3/projects/faae43f959a545e38667858c6f413aa7/users/ad553400204a4ce78106ac6fa04f9e3a/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:00.026825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4cc79-a606-4c28-8da7-edae4d4ec5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faae43f959a545e38667858c6f413aa7, user_id=ad553400204a4ce78106ac6fa04f9e3a, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:00.029537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4cc79-a606-4c28-8da7-edae4d4ec5e4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:00.041505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1247/2465] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:00 2022] PUT /identity/v3/projects/faae43f959a545e38667858c6f413aa7/users/ad553400204a4ce78106ac6fa04f9e3a/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:00.052582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3c1cf-99d1-40f4-b4b2-983053f7ba3e None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:00.052975 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3c1cf-99d1-40f4-b4b2-983053f7ba3e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:00.054022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3c1cf-99d1-40f4-b4b2-983053f7ba3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:00.085591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-dda3c1cf-99d1-40f4-b4b2-983053f7ba3e None None] MFA Rules not processed for user `ad553400204a4ce78106ac6fa04f9e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:00.086913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-dda3c1cf-99d1-40f4-b4b2-983053f7ba3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:00.141432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:00.161848 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1219/2466] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:00.173747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4cc79-a606-4c28-8da7-edae4d4ec5e4 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:00.175547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-30f4cc79-a606-4c28-8da7-edae4d4ec5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:00.239287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4cc79-a606-4c28-8da7-edae4d4ec5e4 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:00.246729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134da0b-597d-4ca6-83cc-eebf342cde6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:00.247419 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134da0b-597d-4ca6-83cc-eebf342cde6e service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:00.247705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134da0b-597d-4ca6-83cc-eebf342cde6e service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:00.247984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134da0b-597d-4ca6-83cc-eebf342cde6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:00.258366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134da0b-597d-4ca6-83cc-eebf342cde6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:00.259840 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134da0b-597d-4ca6-83cc-eebf342cde6e service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:00.269700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1248/2467] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:03.348168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3c1cf-99d1-40f4-b4b2-983053f7ba3e None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:03.420438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3c1cf-99d1-40f4-b4b2-983053f7ba3e None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:03.425284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:03.426167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:03.426477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:03.426747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] PATH_INFO: `/v3/users/922c9358fb9c4cae8f27cab8e967f132` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:03.428239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=922c9358fb9c4cae8f27cab8e967f132)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:03.430070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:03.636532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922c9358fb9c4cae8f27cab8e967f132'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:03.652774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922c9358fb9c4cae8f27cab8e967f132'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:03.718321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922c9358fb9c4cae8f27cab8e967f132'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:03.719886 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922c9358fb9c4cae8f27cab8e967f132'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:03.720831 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922c9358fb9c4cae8f27cab8e967f132'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:03.754458 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1220/2468] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:03 2022] DELETE /identity/v3/users/922c9358fb9c4cae8f27cab8e967f132 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:03.759090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c5286-441b-4fac-8ae6-1385f410f661 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:03.777596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c5286-441b-4fac-8ae6-1385f410f661 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:03.777596 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c5286-441b-4fac-8ae6-1385f410f661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:03.779989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-618c5286-441b-4fac-8ae6-1385f410f661 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:03.781268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-618c5286-441b-4fac-8ae6-1385f410f661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:03.847223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1249/2469] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:03.856992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:03.858420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:03.930448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28543b98-3ed3-453d-9b5d-aa0e75665b0c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:03.934507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad846eb5-6a9c-47e3-8d84-4688f1123db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:03.935178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846eb5-6a9c-47e3-8d84-4688f1123db5 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:03.935493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846eb5-6a9c-47e3-8d84-4688f1123db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:03.935772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846eb5-6a9c-47e3-8d84-4688f1123db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:03.947831 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad846eb5-6a9c-47e3-8d84-4688f1123db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:03.948855 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad846eb5-6a9c-47e3-8d84-4688f1123db5 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:03.962886 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1221/2470] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:04.391895 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c5286-441b-4fac-8ae6-1385f410f661 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:04.393384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-618c5286-441b-4fac-8ae6-1385f410f661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:04.405775 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c5286-441b-4fac-8ae6-1385f410f661 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:04.410764 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:04.415127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:04.415127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:04.415127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] PATH_INFO: `/v3/projects/f7707223cebb4947982cdcd0047c3031` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:04.415127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7707223cebb4947982cdcd0047c3031)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:04.415606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:04.427500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:04.550948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7707223cebb4947982cdcd0047c3031', 'request_id': 'req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:04.557499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7707223cebb4947982cdcd0047c3031', 'request_id': 'req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:04.563856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7707223cebb4947982cdcd0047c3031', 'request_id': 'req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:04.634731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] The token cache is being invalidate because project f7707223cebb4947982cdcd0047c3031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:04.635043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:04.635738 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:04.637316 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1250/2471] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:04 2022] DELETE /identity/v3/projects/f7707223cebb4947982cdcd0047c3031 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:04.641572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad846eb5-6a9c-47e3-8d84-4688f1123db5 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:04.651632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad846eb5-6a9c-47e3-8d84-4688f1123db5 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:04.660405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:04.710627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:04.711593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:04.711850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:04.712128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] PATH_INFO: `/v3/users/ad553400204a4ce78106ac6fa04f9e3a` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:04.713309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad553400204a4ce78106ac6fa04f9e3a)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:04.715222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:04.878212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad553400204a4ce78106ac6fa04f9e3a'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:04.885609 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad553400204a4ce78106ac6fa04f9e3a'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:04.926600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad553400204a4ce78106ac6fa04f9e3a'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:04.927226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad553400204a4ce78106ac6fa04f9e3a'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:04.927883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-62942885-94a5-4b3d-b7d4-f1b455182383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad553400204a4ce78106ac6fa04f9e3a'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:04.946304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1222/2472] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:04 2022] DELETE /identity/v3/users/ad553400204a4ce78106ac6fa04f9e3a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:05.345312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:05.347589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:05.374686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a25d7-4ada-4c5a-8c94-1f84af5d62c4 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:05.455024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:05.456444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:05.456577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:05.456758 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] PATH_INFO: `/v3/projects/faae43f959a545e38667858c6f413aa7` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:05.460221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] RBAC: Authorizing `identity:delete_project(project_id=faae43f959a545e38667858c6f413aa7)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:05.462288 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:05.622216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faae43f959a545e38667858c6f413aa7', 'request_id': 'req-c12d34de-6a39-46e3-b083-5200d635642f'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:05.629340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faae43f959a545e38667858c6f413aa7', 'request_id': 'req-c12d34de-6a39-46e3-b083-5200d635642f'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:05.635447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faae43f959a545e38667858c6f413aa7', 'request_id': 'req-c12d34de-6a39-46e3-b083-5200d635642f'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:05.711484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] The token cache is being invalidate because project faae43f959a545e38667858c6f413aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:05.712135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:05.713284 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c12d34de-6a39-46e3-b083-5200d635642f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:05.716397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1251/2473] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:05 2022] DELETE /identity/v3/projects/faae43f959a545e38667858c6f413aa7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:05.722274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae47b4-3707-4091-af4b-c56720963da2 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:05.722806 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae47b4-3707-4091-af4b-c56720963da2 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:05.722928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae47b4-3707-4091-af4b-c56720963da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:05.743761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-37ae47b4-3707-4091-af4b-c56720963da2 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:05.745019 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-37ae47b4-3707-4091-af4b-c56720963da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:05.823290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1223/2474] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:59:05.833341 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a43b0-37a9-410b-a50e-1bc23e9a3aef None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:05.833629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a43b0-37a9-410b-a50e-1bc23e9a3aef None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:05.833910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a43b0-37a9-410b-a50e-1bc23e9a3aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:05.866638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-878a43b0-37a9-410b-a50e-1bc23e9a3aef None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:05.867912 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-878a43b0-37a9-410b-a50e-1bc23e9a3aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:05.876746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1252/2475] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:05.881862 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae47b4-3707-4091-af4b-c56720963da2 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:05.897723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae47b4-3707-4091-af4b-c56720963da2 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:05.906786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8e860-8e29-4143-a997-64fe2d6ce699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:05.906786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8e860-8e29-4143-a997-64fe2d6ce699 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:05.906786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8e860-8e29-4143-a997-64fe2d6ce699 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:05.906786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8e860-8e29-4143-a997-64fe2d6ce699 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:05.907253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8e860-8e29-4143-a997-64fe2d6ce699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:59:05.907253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8e860-8e29-4143-a997-64fe2d6ce699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:05.908879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8e860-8e29-4143-a997-64fe2d6ce699 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:05.929100 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1224/2476] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:59:05.933173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a43b0-37a9-410b-a50e-1bc23e9a3aef None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:05.941321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a43b0-37a9-410b-a50e-1bc23e9a3aef None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:05.946343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed00e2-50bf-4558-9c6b-4a7b0daff5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:05.947038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed00e2-50bf-4558-9c6b-4a7b0daff5cf admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:05.947321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed00e2-50bf-4558-9c6b-4a7b0daff5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:05.947627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed00e2-50bf-4558-9c6b-4a7b0daff5cf admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:05.948396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed00e2-50bf-4558-9c6b-4a7b0daff5cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:05.951274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed00e2-50bf-4558-9c6b-4a7b0daff5cf admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:06.047621 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:06.055637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1253/2477] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:59:05 2022] POST /identity/v3/projects => generated 399 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:06.060174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8e860-8e29-4143-a997-64fe2d6ce699 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:06.073212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8e860-8e29-4143-a997-64fe2d6ce699 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:06.088272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:06.135023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9975fb-569c-42b2-9d81-c55adc9d0304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:06.135652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9975fb-569c-42b2-9d81-c55adc9d0304 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:06.135940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9975fb-569c-42b2-9d81-c55adc9d0304 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:06.136218 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9975fb-569c-42b2-9d81-c55adc9d0304 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:06.136926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9975fb-569c-42b2-9d81-c55adc9d0304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:06.138881 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9975fb-569c-42b2-9d81-c55adc9d0304 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:06.258568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1225/2478] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:59:06 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:06.262769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed00e2-50bf-4558-9c6b-4a7b0daff5cf admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:06.274345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed00e2-50bf-4558-9c6b-4a7b0daff5cf admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:06.279770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9659-a32b-4eb9-baee-154922d098ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:06.280517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9659-a32b-4eb9-baee-154922d098ee admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:06.280900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9659-a32b-4eb9-baee-154922d098ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:06.281920 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9659-a32b-4eb9-baee-154922d098ee admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:06.282662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9659-a32b-4eb9-baee-154922d098ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:06.284378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9659-a32b-4eb9-baee-154922d098ee admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:06.296449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1254/2479] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:06.300655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9975fb-569c-42b2-9d81-c55adc9d0304 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:06.311932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9975fb-569c-42b2-9d81-c55adc9d0304 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:06.317285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327f6e-7aa5-478e-b5c0-7ccee1763055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:06.317958 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327f6e-7aa5-478e-b5c0-7ccee1763055 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:06.318247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327f6e-7aa5-478e-b5c0-7ccee1763055 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:06.318526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327f6e-7aa5-478e-b5c0-7ccee1763055 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:06.319301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327f6e-7aa5-478e-b5c0-7ccee1763055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:06.321191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327f6e-7aa5-478e-b5c0-7ccee1763055 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:06.333392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1226/2480] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:06.337687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9659-a32b-4eb9-baee-154922d098ee admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:06.348787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9659-a32b-4eb9-baee-154922d098ee admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:06.356231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf59c62-e7a1-47a5-8f47-8d4b0644902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:06.357135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59c62-e7a1-47a5-8f47-8d4b0644902b admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:06.357413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59c62-e7a1-47a5-8f47-8d4b0644902b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:06.357702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf59c62-e7a1-47a5-8f47-8d4b0644902b admin admin] PATH_INFO: `/v3/projects/2ef3eb2acac64f2ba6d282646c424008/users/ed4b9008415c465a86001cb3d0708f76/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:06.374039 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf59c62-e7a1-47a5-8f47-8d4b0644902b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef3eb2acac64f2ba6d282646c424008, user_id=ed4b9008415c465a86001cb3d0708f76, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:06.377586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf59c62-e7a1-47a5-8f47-8d4b0644902b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:06.472730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1255/2481] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:06 2022] PUT /identity/v3/projects/2ef3eb2acac64f2ba6d282646c424008/users/ed4b9008415c465a86001cb3d0708f76/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:06.484576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c45e74-1596-4b12-8c5f-ba85110f730b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:06.484910 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c45e74-1596-4b12-8c5f-ba85110f730b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:06.485194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c45e74-1596-4b12-8c5f-ba85110f730b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:06.513507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-e2c45e74-1596-4b12-8c5f-ba85110f730b None None] MFA Rules not processed for user `ed4b9008415c465a86001cb3d0708f76`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:06.514714 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e2c45e74-1596-4b12-8c5f-ba85110f730b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:06.583753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1227/2482] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:06.588439 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf59c62-e7a1-47a5-8f47-8d4b0644902b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:06.660849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf59c62-e7a1-47a5-8f47-8d4b0644902b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:06.665565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52c58-b29a-4273-8959-ce6296717cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:06.666245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52c58-b29a-4273-8959-ce6296717cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:06.666530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52c58-b29a-4273-8959-ce6296717cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:06.666809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52c58-b29a-4273-8959-ce6296717cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:06.667553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52c58-b29a-4273-8959-ce6296717cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:06.669520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52c58-b29a-4273-8959-ce6296717cf6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:06.749211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1256/2483] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:59:06 2022] POST /identity/v3/projects => generated 401 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:06.751253 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c45e74-1596-4b12-8c5f-ba85110f730b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:06.762811 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c45e74-1596-4b12-8c5f-ba85110f730b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:06.822012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf4bc1-b683-424f-bf31-5b318a6e8e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:06.822686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4bc1-b683-424f-bf31-5b318a6e8e85 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:06.822965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4bc1-b683-424f-bf31-5b318a6e8e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:06.823238 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4bc1-b683-424f-bf31-5b318a6e8e85 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:06.823947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf4bc1-b683-424f-bf31-5b318a6e8e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:06.825861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf4bc1-b683-424f-bf31-5b318a6e8e85 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:06.938296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1228/2484] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:59:06 2022] POST /identity/v3/users => generated 307 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:06.942553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52c58-b29a-4273-8959-ce6296717cf6 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:06.968032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52c58-b29a-4273-8959-ce6296717cf6 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:06.974096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951ee92-dff4-41bd-8f44-90e56940bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:06.977655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ee92-dff4-41bd-8f44-90e56940bceb admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:06.977655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ee92-dff4-41bd-8f44-90e56940bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:06.977655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951ee92-dff4-41bd-8f44-90e56940bceb admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:06.977655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951ee92-dff4-41bd-8f44-90e56940bceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:06.978079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951ee92-dff4-41bd-8f44-90e56940bceb admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:06.991111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1257/2485] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:06.997376 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf4bc1-b683-424f-bf31-5b318a6e8e85 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:07.006791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf4bc1-b683-424f-bf31-5b318a6e8e85 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:07.011780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa421a-f002-4e70-a623-e924da92b5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:07.012676 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa421a-f002-4e70-a623-e924da92b5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:07.012957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa421a-f002-4e70-a623-e924da92b5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:07.013234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa421a-f002-4e70-a623-e924da92b5dd admin admin] PATH_INFO: `/v3/projects/d63f202db0874a71bb45f5a33a6ca875/users/ef0f2a4a463647a28942a02dd5cc6d5e/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:07.029521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:07.033446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa421a-f002-4e70-a623-e924da92b5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63f202db0874a71bb45f5a33a6ca875, user_id=ef0f2a4a463647a28942a02dd5cc6d5e, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:07.036296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa421a-f002-4e70-a623-e924da92b5dd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:07.098535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1229/2486] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:06 2022] PUT /identity/v3/projects/d63f202db0874a71bb45f5a33a6ca875/users/ef0f2a4a463647a28942a02dd5cc6d5e/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:07.102559 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951ee92-dff4-41bd-8f44-90e56940bceb admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:07.113375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951ee92-dff4-41bd-8f44-90e56940bceb admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:07.170539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740df8a-53f5-438e-8f8f-44a8efa32f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:07.171209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740df8a-53f5-438e-8f8f-44a8efa32f04 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:07.171531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740df8a-53f5-438e-8f8f-44a8efa32f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:07.172604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740df8a-53f5-438e-8f8f-44a8efa32f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:07.173522 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740df8a-53f5-438e-8f8f-44a8efa32f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:07.175243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740df8a-53f5-438e-8f8f-44a8efa32f04 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:07.189267 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1258/2487] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:07.190233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa421a-f002-4e70-a623-e924da92b5dd admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:07.201050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa421a-f002-4e70-a623-e924da92b5dd admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:07.206002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a44a8-8ab5-4ed4-9634-51eee8f79a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:07.206871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a44a8-8ab5-4ed4-9634-51eee8f79a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:07.207151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a44a8-8ab5-4ed4-9634-51eee8f79a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:07.207479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a44a8-8ab5-4ed4-9634-51eee8f79a4b admin admin] PATH_INFO: `/v3/projects/d63f202db0874a71bb45f5a33a6ca875/users/ef0f2a4a463647a28942a02dd5cc6d5e/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:07.209464 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a44a8-8ab5-4ed4-9634-51eee8f79a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63f202db0874a71bb45f5a33a6ca875, user_id=ef0f2a4a463647a28942a02dd5cc6d5e, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:07.212172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a44a8-8ab5-4ed4-9634-51eee8f79a4b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:07.223040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1230/2488] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:07 2022] PUT /identity/v3/projects/d63f202db0874a71bb45f5a33a6ca875/users/ef0f2a4a463647a28942a02dd5cc6d5e/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:07.233144 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1da9d-cb22-49b9-afa8-fc5de062b77e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:07.233436 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1da9d-cb22-49b9-afa8-fc5de062b77e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:07.233719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1da9d-cb22-49b9-afa8-fc5de062b77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:07.261072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-7ea1da9d-cb22-49b9-afa8-fc5de062b77e None None] MFA Rules not processed for user `ef0f2a4a463647a28942a02dd5cc6d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:07.262280 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7ea1da9d-cb22-49b9-afa8-fc5de062b77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:07.289421 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:07.340004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1259/2489] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:07.352060 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a44a8-8ab5-4ed4-9634-51eee8f79a4b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:07.353946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-7b7a44a8-8ab5-4ed4-9634-51eee8f79a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:07.412725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a44a8-8ab5-4ed4-9634-51eee8f79a4b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:07.416634 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543b009-efee-4a82-9153-2231f1811d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:07.417286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543b009-efee-4a82-9153-2231f1811d27 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:07.417573 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543b009-efee-4a82-9153-2231f1811d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:07.417852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543b009-efee-4a82-9153-2231f1811d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:07.428442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543b009-efee-4a82-9153-2231f1811d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:07.429871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543b009-efee-4a82-9153-2231f1811d27 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:07.439826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1231/2490] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:07.661188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1da9d-cb22-49b9-afa8-fc5de062b77e None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:07.671252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1da9d-cb22-49b9-afa8-fc5de062b77e None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:07.675253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e750e2e-753d-408f-aae7-cadb561b6458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:07.675939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e750e2e-753d-408f-aae7-cadb561b6458 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:07.676225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e750e2e-753d-408f-aae7-cadb561b6458 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:07.676507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e750e2e-753d-408f-aae7-cadb561b6458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:07.736471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e750e2e-753d-408f-aae7-cadb561b6458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:07.738059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e750e2e-753d-408f-aae7-cadb561b6458 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:07.747526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1260/2491] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:09.921183 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543b009-efee-4a82-9153-2231f1811d27 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:09.923648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-0543b009-efee-4a82-9153-2231f1811d27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:09.985851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543b009-efee-4a82-9153-2231f1811d27 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:09.989738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdda4e-c82f-400f-9b67-a60e225306d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:09.990413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdda4e-c82f-400f-9b67-a60e225306d8 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:09.990883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdda4e-c82f-400f-9b67-a60e225306d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:09.991165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdda4e-c82f-400f-9b67-a60e225306d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:09.993194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c4cdda4e-c82f-400f-9b67-a60e225306d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:10.072477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdda4e-c82f-400f-9b67-a60e225306d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:10.074017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdda4e-c82f-400f-9b67-a60e225306d8 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:10.087636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1232/2492] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:12.793061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e750e2e-753d-408f-aae7-cadb561b6458 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:12.805609 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e750e2e-753d-408f-aae7-cadb561b6458 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:12.810842 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:12.811770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:12.812057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:12.812882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] PATH_INFO: `/v3/users/ed4b9008415c465a86001cb3d0708f76` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:12.814143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4b9008415c465a86001cb3d0708f76)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:12.816164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:13.011449 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4b9008415c465a86001cb3d0708f76'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:13.027189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4b9008415c465a86001cb3d0708f76'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:13.161090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4b9008415c465a86001cb3d0708f76'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:13.175769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4b9008415c465a86001cb3d0708f76'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:13.176914 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4b9008415c465a86001cb3d0708f76'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:13.184210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1261/2493] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:12 2022] DELETE /identity/v3/users/ed4b9008415c465a86001cb3d0708f76 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:13.189110 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821e3b-d60a-4eb5-a180-28eeab5040d2 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:13.190188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821e3b-d60a-4eb5-a180-28eeab5040d2 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:13.191257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1821e3b-d60a-4eb5-a180-28eeab5040d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:13.214755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c1821e3b-d60a-4eb5-a180-28eeab5040d2 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:13.216118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c1821e3b-d60a-4eb5-a180-28eeab5040d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:13.246070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:13.280653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1233/2494] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:13.291819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:13.293308 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:13.336459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:13.370207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336121eb-fdb9-41c5-94da-876ba72a81d6 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:13.374006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb4ca1-5b2c-409e-aacb-d594f2154bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:13.374777 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb4ca1-5b2c-409e-aacb-d594f2154bbd service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:13.375251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb4ca1-5b2c-409e-aacb-d594f2154bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:13.375779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb4ca1-5b2c-409e-aacb-d594f2154bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:13.385950 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb4ca1-5b2c-409e-aacb-d594f2154bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:13.387403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb4ca1-5b2c-409e-aacb-d594f2154bbd service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:13.411571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1262/2495] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:13.678759 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1821e3b-d60a-4eb5-a180-28eeab5040d2 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:13.681488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c1821e3b-d60a-4eb5-a180-28eeab5040d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:13.703550 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1821e3b-d60a-4eb5-a180-28eeab5040d2 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:13.711606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:13.713139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:13.713688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:13.714208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] PATH_INFO: `/v3/users/01bb3df8b4b649388d1a0f6c24e18f1b` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:13.716369 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=01bb3df8b4b649388d1a0f6c24e18f1b)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:13.720661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:13.859967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb4ca1-5b2c-409e-aacb-d594f2154bbd service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:13.861536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-acdb4ca1-5b2c-409e-aacb-d594f2154bbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:13.874408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01bb3df8b4b649388d1a0f6c24e18f1b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:13.878024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb4ca1-5b2c-409e-aacb-d594f2154bbd service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:13.883734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:13.884132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01bb3df8b4b649388d1a0f6c24e18f1b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:13.888278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:13.888278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:13.888278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] PATH_INFO: `/v3/projects/2ef3eb2acac64f2ba6d282646c424008` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:13.889152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef3eb2acac64f2ba6d282646c424008)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:13.891681 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:13.965206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01bb3df8b4b649388d1a0f6c24e18f1b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:13.965828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01bb3df8b4b649388d1a0f6c24e18f1b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:13.966429 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01bb3df8b4b649388d1a0f6c24e18f1b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:13.985793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1234/2496] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:13 2022] DELETE /identity/v3/users/01bb3df8b4b649388d1a0f6c24e18f1b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:14.009718 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef3eb2acac64f2ba6d282646c424008', 'request_id': 'req-ad8b874b-463d-431a-812d-4cd972e30085'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.017089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef3eb2acac64f2ba6d282646c424008', 'request_id': 'req-ad8b874b-463d-431a-812d-4cd972e30085'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.023430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef3eb2acac64f2ba6d282646c424008', 'request_id': 'req-ad8b874b-463d-431a-812d-4cd972e30085'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.105739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] The token cache is being invalidate because project 2ef3eb2acac64f2ba6d282646c424008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:14.107141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.107864 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.112824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1263/2497] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:13 2022] DELETE /identity/v3/projects/2ef3eb2acac64f2ba6d282646c424008 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:14.113801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:14.115587 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:14.195754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5704ee-dd95-461b-9420-040f0d951fbe admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:14.245440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:14.255992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:14.256980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:14.257294 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:14.259393 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] PATH_INFO: `/v3/users/ef0f2a4a463647a28942a02dd5cc6d5e` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:14.259989 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0f2a4a463647a28942a02dd5cc6d5e)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:14.260287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:14.261788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:14.261943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:14.278763 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b874b-463d-431a-812d-4cd972e30085 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:14.283942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:14.285082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:14.285452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:14.286240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] PATH_INFO: `/v3/projects/794e7ebcf5c3436081b8e8d39907b655` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:14.287757 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] RBAC: Authorizing `identity:delete_project(project_id=794e7ebcf5c3436081b8e8d39907b655)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:14.289923 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:14.643015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0f2a4a463647a28942a02dd5cc6d5e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.643892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794e7ebcf5c3436081b8e8d39907b655', 'request_id': 'req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.650232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0f2a4a463647a28942a02dd5cc6d5e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.650407 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794e7ebcf5c3436081b8e8d39907b655', 'request_id': 'req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.657946 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794e7ebcf5c3436081b8e8d39907b655', 'request_id': 'req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.721339 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0f2a4a463647a28942a02dd5cc6d5e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.721951 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0f2a4a463647a28942a02dd5cc6d5e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.722574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-47874fe8-213d-4510-bc0d-d0c500cfa26c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0f2a4a463647a28942a02dd5cc6d5e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.762509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1235/2498] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:14 2022] DELETE /identity/v3/users/ef0f2a4a463647a28942a02dd5cc6d5e => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:14.805086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] The token cache is being invalidate because project 794e7ebcf5c3436081b8e8d39907b655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:14.809802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.809802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-72ffa5ed-46d9-46fc-bdfd-3d0e9b0a85af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:14.809802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1264/2499] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:14 2022] DELETE /identity/v3/projects/794e7ebcf5c3436081b8e8d39907b655 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:14.814840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfcaf-1275-48af-aa92-47f0729febd1 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:14.815132 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfcaf-1275-48af-aa92-47f0729febd1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:14.815466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfcaf-1275-48af-aa92-47f0729febd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:14.837508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-b81bfcaf-1275-48af-aa92-47f0729febd1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:14.838746 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b81bfcaf-1275-48af-aa92-47f0729febd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:14.906500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1236/2500] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:59:14.914626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7453cb9-e47d-4cdb-975c-6d7567d8e1c1 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:14.915152 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7453cb9-e47d-4cdb-975c-6d7567d8e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:14.915259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7453cb9-e47d-4cdb-975c-6d7567d8e1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:14.936140 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-c7453cb9-e47d-4cdb-975c-6d7567d8e1c1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:14.937613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c7453cb9-e47d-4cdb-975c-6d7567d8e1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:14.946645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1265/2501] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:14.950849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bfcaf-1275-48af-aa92-47f0729febd1 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:14.961817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bfcaf-1275-48af-aa92-47f0729febd1 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:14.967566 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5c37e-1de3-48d6-968d-e2725881a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:14.969850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5c37e-1de3-48d6-968d-e2725881a1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:14.970697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5c37e-1de3-48d6-968d-e2725881a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:14.971484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5c37e-1de3-48d6-968d-e2725881a1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:14.972282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5c37e-1de3-48d6-968d-e2725881a1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:59:14.972596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5c37e-1de3-48d6-968d-e2725881a1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:14.974315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5c37e-1de3-48d6-968d-e2725881a1f0 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:14.988323 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1237/2502] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:59:14.992295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7453cb9-e47d-4cdb-975c-6d7567d8e1c1 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.003008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7453cb9-e47d-4cdb-975c-6d7567d8e1c1 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.008177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b535184-9d9d-4c66-bdd9-c4bc5bc9198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.008852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b535184-9d9d-4c66-bdd9-c4bc5bc9198d admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.009164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b535184-9d9d-4c66-bdd9-c4bc5bc9198d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.009472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b535184-9d9d-4c66-bdd9-c4bc5bc9198d admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.010254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b535184-9d9d-4c66-bdd9-c4bc5bc9198d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.012497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b535184-9d9d-4c66-bdd9-c4bc5bc9198d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.127193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1266/2503] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:59:14 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:15.131495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5c37e-1de3-48d6-968d-e2725881a1f0 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.142696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5c37e-1de3-48d6-968d-e2725881a1f0 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.200010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772a69-a043-45a1-be11-4251e9f90122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.200703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772a69-a043-45a1-be11-4251e9f90122 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.200957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772a69-a043-45a1-be11-4251e9f90122 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.201234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772a69-a043-45a1-be11-4251e9f90122 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.201920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6772a69-a043-45a1-be11-4251e9f90122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.204648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6772a69-a043-45a1-be11-4251e9f90122 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.293853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b535184-9d9d-4c66-bdd9-c4bc5bc9198d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.295693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0b535184-9d9d-4c66-bdd9-c4bc5bc9198d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:15.311271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:15.311995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b535184-9d9d-4c66-bdd9-c4bc5bc9198d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.318116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.318467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1238/2504] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:59:15 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:15.319061 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.319342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.319644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] PATH_INFO: `/v3/projects/d63f202db0874a71bb45f5a33a6ca875` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.321014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63f202db0874a71bb45f5a33a6ca875)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.322210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772a69-a043-45a1-be11-4251e9f90122 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.323195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.331650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:15.334622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772a69-a043-45a1-be11-4251e9f90122 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.339488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a636df-e799-4697-922a-998417ff0aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.340179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a636df-e799-4697-922a-998417ff0aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.340473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a636df-e799-4697-922a-998417ff0aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.340781 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a636df-e799-4697-922a-998417ff0aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.341521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a636df-e799-4697-922a-998417ff0aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.343187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a636df-e799-4697-922a-998417ff0aa1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.354622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1239/2505] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:15.367153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a636df-e799-4697-922a-998417ff0aa1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.377736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a636df-e799-4697-922a-998417ff0aa1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.383766 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e82f-71b1-4692-87cb-7f51eee0d40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.384425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e82f-71b1-4692-87cb-7f51eee0d40c admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.384714 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e82f-71b1-4692-87cb-7f51eee0d40c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.384995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e82f-71b1-4692-87cb-7f51eee0d40c admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.385718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e82f-71b1-4692-87cb-7f51eee0d40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.387322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e82f-71b1-4692-87cb-7f51eee0d40c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.398859 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1240/2506] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:15.403077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e82f-71b1-4692-87cb-7f51eee0d40c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.412956 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e82f-71b1-4692-87cb-7f51eee0d40c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.417704 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0482f-bd8e-46da-a85c-6c8c53966f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.418586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0482f-bd8e-46da-a85c-6c8c53966f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.418874 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0482f-bd8e-46da-a85c-6c8c53966f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.419153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0482f-bd8e-46da-a85c-6c8c53966f69 admin admin] PATH_INFO: `/v3/projects/24d6b260ac424c83a77239f5004d4058/users/8554488cd89d46d1adf200ed3c33c061/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.434329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0482f-bd8e-46da-a85c-6c8c53966f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d6b260ac424c83a77239f5004d4058, user_id=8554488cd89d46d1adf200ed3c33c061, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.437565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0482f-bd8e-46da-a85c-6c8c53966f69 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.454638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63f202db0874a71bb45f5a33a6ca875', 'request_id': 'req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:15.461349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63f202db0874a71bb45f5a33a6ca875', 'request_id': 'req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:15.466861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63f202db0874a71bb45f5a33a6ca875', 'request_id': 'req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:15.509809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1241/2507] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:15 2022] PUT /identity/v3/projects/24d6b260ac424c83a77239f5004d4058/users/8554488cd89d46d1adf200ed3c33c061/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:15.520653 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09c1c-d2c9-4182-89a3-c9a54f85b50e None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.520938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09c1c-d2c9-4182-89a3-c9a54f85b50e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.521215 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09c1c-d2c9-4182-89a3-c9a54f85b50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.538186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] The token cache is being invalidate because project d63f202db0874a71bb45f5a33a6ca875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:15.538423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:15.539082 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7e8f6e10-7a75-43cd-aca7-da26cd98c2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:15.540658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1267/2508] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:15 2022] DELETE /identity/v3/projects/d63f202db0874a71bb45f5a33a6ca875 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:15.545285 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b0a6-93cc-452f-8f75-9878f8aaa818 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.545579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b0a6-93cc-452f-8f75-9878f8aaa818 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.545852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b0a6-93cc-452f-8f75-9878f8aaa818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.549659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-acd09c1c-d2c9-4182-89a3-c9a54f85b50e None None] MFA Rules not processed for user `8554488cd89d46d1adf200ed3c33c061`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:15.550961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-acd09c1c-d2c9-4182-89a3-c9a54f85b50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:15.565644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-da08b0a6-93cc-452f-8f75-9878f8aaa818 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:15.566863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-da08b0a6-93cc-452f-8f75-9878f8aaa818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:15.616640 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1242/2509] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:59:15.620633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd09c1c-d2c9-4182-89a3-c9a54f85b50e None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.621979 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-acd09c1c-d2c9-4182-89a3-c9a54f85b50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:15.630601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1268/2510] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:59:15.636698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd09c1c-d2c9-4182-89a3-c9a54f85b50e None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.639662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651628-e789-4c0e-8ad7-ae89e32dcb5f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.639956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651628-e789-4c0e-8ad7-ae89e32dcb5f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.640303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9651628-e789-4c0e-8ad7-ae89e32dcb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.642256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78629161-0388-4536-8a29-bb930a5bc913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.642921 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629161-0388-4536-8a29-bb930a5bc913 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.643234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629161-0388-4536-8a29-bb930a5bc913 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.643552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629161-0388-4536-8a29-bb930a5bc913 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.644297 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78629161-0388-4536-8a29-bb930a5bc913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.646249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78629161-0388-4536-8a29-bb930a5bc913 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.659686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a9651628-e789-4c0e-8ad7-ae89e32dcb5f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:15.660897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a9651628-e789-4c0e-8ad7-ae89e32dcb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:15.668863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1269/2511] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:59:15.673075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9651628-e789-4c0e-8ad7-ae89e32dcb5f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.682184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9651628-e789-4c0e-8ad7-ae89e32dcb5f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.686747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852fe86-d92c-43ca-8c9d-615ff91c839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.688070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852fe86-d92c-43ca-8c9d-615ff91c839d admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.688350 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852fe86-d92c-43ca-8c9d-615ff91c839d admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.688621 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852fe86-d92c-43ca-8c9d-615ff91c839d admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.689336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852fe86-d92c-43ca-8c9d-615ff91c839d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:59:15.689640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852fe86-d92c-43ca-8c9d-615ff91c839d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.691223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852fe86-d92c-43ca-8c9d-615ff91c839d admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.702584 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1270/2512] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:59:15.709754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852fe86-d92c-43ca-8c9d-615ff91c839d admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.720719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852fe86-d92c-43ca-8c9d-615ff91c839d admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.725829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b93c09-3000-40ad-aeff-ae40391035b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.726642 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93c09-3000-40ad-aeff-ae40391035b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.726931 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93c09-3000-40ad-aeff-ae40391035b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.727209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93c09-3000-40ad-aeff-ae40391035b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.727929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b93c09-3000-40ad-aeff-ae40391035b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.729909 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b93c09-3000-40ad-aeff-ae40391035b0 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.773617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1243/2513] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:59:15 2022] POST /identity/v3/projects => generated 405 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:59:15.777387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78629161-0388-4536-8a29-bb930a5bc913 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.839904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78629161-0388-4536-8a29-bb930a5bc913 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.845070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54cb90-7312-408b-9e38-1683bb68bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.846045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54cb90-7312-408b-9e38-1683bb68bba9 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.846505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54cb90-7312-408b-9e38-1683bb68bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.846791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54cb90-7312-408b-9e38-1683bb68bba9 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.847546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54cb90-7312-408b-9e38-1683bb68bba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.851460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1271/2514] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:59:15 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:59:15.855753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54cb90-7312-408b-9e38-1683bb68bba9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.855896 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b93c09-3000-40ad-aeff-ae40391035b0 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.910611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:15.920973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b93c09-3000-40ad-aeff-ae40391035b0 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.926987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5642655-2c89-44ce-adf0-3ec209f41517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.927710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5642655-2c89-44ce-adf0-3ec209f41517 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.928025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5642655-2c89-44ce-adf0-3ec209f41517 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.928438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5642655-2c89-44ce-adf0-3ec209f41517 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.929143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5642655-2c89-44ce-adf0-3ec209f41517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.931422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5642655-2c89-44ce-adf0-3ec209f41517 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.932892 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:15.939881 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1244/2515] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:59:15 2022] POST /identity/v3/users => generated 309 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:59:15.943896 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54cb90-7312-408b-9e38-1683bb68bba9 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.954072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54cb90-7312-408b-9e38-1683bb68bba9 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.958796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e0a9-7cbf-470c-9239-7b55d0ab61e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.959549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e0a9-7cbf-470c-9239-7b55d0ab61e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.959866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e0a9-7cbf-470c-9239-7b55d0ab61e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.960150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e0a9-7cbf-470c-9239-7b55d0ab61e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:15.960878 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738e0a9-7cbf-470c-9239-7b55d0ab61e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:15.962482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738e0a9-7cbf-470c-9239-7b55d0ab61e1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:15.973092 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1245/2516] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:15.979289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e0a9-7cbf-470c-9239-7b55d0ab61e1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:15.990254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e0a9-7cbf-470c-9239-7b55d0ab61e1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:15.995821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648c11f-7e7c-46f0-9678-fa0142c7ee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:15.996966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648c11f-7e7c-46f0-9678-fa0142c7ee90 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:15.997344 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648c11f-7e7c-46f0-9678-fa0142c7ee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:15.997721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648c11f-7e7c-46f0-9678-fa0142c7ee90 admin admin] PATH_INFO: `/v3/projects/01912d5797774b7fb29d614d08f02da8/users/78ef5193116f46b3adb1dd188446e4f3/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.014229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648c11f-7e7c-46f0-9678-fa0142c7ee90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01912d5797774b7fb29d614d08f02da8, user_id=78ef5193116f46b3adb1dd188446e4f3, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:16.017282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648c11f-7e7c-46f0-9678-fa0142c7ee90 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:16.036177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1272/2517] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:59:15 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:59:16.040222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5642655-2c89-44ce-adf0-3ec209f41517 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:16.051320 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5642655-2c89-44ce-adf0-3ec209f41517 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:16.056564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235b6a7-b750-4f65-8bc4-6dd4f5556288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:16.057390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235b6a7-b750-4f65-8bc4-6dd4f5556288 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:16.057687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235b6a7-b750-4f65-8bc4-6dd4f5556288 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:16.057972 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235b6a7-b750-4f65-8bc4-6dd4f5556288 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.058709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235b6a7-b750-4f65-8bc4-6dd4f5556288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:16.060366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235b6a7-b750-4f65-8bc4-6dd4f5556288 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:16.072558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1273/2518] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:59:16.076689 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235b6a7-b750-4f65-8bc4-6dd4f5556288 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:16.087584 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235b6a7-b750-4f65-8bc4-6dd4f5556288 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:16.092516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983b19e-a829-476a-9636-62d119fbb6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:16.093143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983b19e-a829-476a-9636-62d119fbb6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:16.093493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983b19e-a829-476a-9636-62d119fbb6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:16.093967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983b19e-a829-476a-9636-62d119fbb6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.094964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983b19e-a829-476a-9636-62d119fbb6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:16.096666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983b19e-a829-476a-9636-62d119fbb6b4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:16.108014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1274/2519] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:59:16.112337 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983b19e-a829-476a-9636-62d119fbb6b4 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:16.121902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983b19e-a829-476a-9636-62d119fbb6b4 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:16.127408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f076f6d-0d4b-4f00-b5cd-71f82efd1666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:16.128385 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f076f6d-0d4b-4f00-b5cd-71f82efd1666 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:16.128668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f076f6d-0d4b-4f00-b5cd-71f82efd1666 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:16.128947 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f076f6d-0d4b-4f00-b5cd-71f82efd1666 admin admin] PATH_INFO: `/v3/projects/89bcba80fc484ad88fb54bd14b1b4339/users/c4b5d1809aa84059a92a8cd460f06c62/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.133430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1246/2520] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:15 2022] PUT /identity/v3/projects/01912d5797774b7fb29d614d08f02da8/users/78ef5193116f46b3adb1dd188446e4f3/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:16.137351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648c11f-7e7c-46f0-9678-fa0142c7ee90 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:16.144277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f076f6d-0d4b-4f00-b5cd-71f82efd1666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bcba80fc484ad88fb54bd14b1b4339, user_id=c4b5d1809aa84059a92a8cd460f06c62, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:16.146915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f076f6d-0d4b-4f00-b5cd-71f82efd1666 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:16.198832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648c11f-7e7c-46f0-9678-fa0142c7ee90 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:16.204252 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75324e-2904-489a-876a-d0c7cd30bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:16.204912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75324e-2904-489a-876a-d0c7cd30bb2f admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:16.205195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75324e-2904-489a-876a-d0c7cd30bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:16.205473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75324e-2904-489a-876a-d0c7cd30bb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.206190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75324e-2904-489a-876a-d0c7cd30bb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:16.207822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75324e-2904-489a-876a-d0c7cd30bb2f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:16.217624 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1247/2521] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:59:16.222178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75324e-2904-489a-876a-d0c7cd30bb2f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:16.228158 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1275/2522] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:16 2022] PUT /identity/v3/projects/89bcba80fc484ad88fb54bd14b1b4339/users/c4b5d1809aa84059a92a8cd460f06c62/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:16.229535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de094f7-afc0-4155-b331-81321873cf09 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:16.229828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de094f7-afc0-4155-b331-81321873cf09 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:16.230109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de094f7-afc0-4155-b331-81321873cf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.232174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75324e-2904-489a-876a-d0c7cd30bb2f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:16.247602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-9de094f7-afc0-4155-b331-81321873cf09 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:16.248799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9de094f7-afc0-4155-b331-81321873cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:16.297878 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0ab9-2b6f-41ba-9ab9-433e3243d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:16.298811 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0ab9-2b6f-41ba-9ab9-433e3243d208 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:16.299091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0ab9-2b6f-41ba-9ab9-433e3243d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:16.299486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c0ab9-2b6f-41ba-9ab9-433e3243d208 admin admin] PATH_INFO: `/v3/projects/01912d5797774b7fb29d614d08f02da8/users/78ef5193116f46b3adb1dd188446e4f3/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.301513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c0ab9-2b6f-41ba-9ab9-433e3243d208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01912d5797774b7fb29d614d08f02da8, user_id=78ef5193116f46b3adb1dd188446e4f3, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:16.304590 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c0ab9-2b6f-41ba-9ab9-433e3243d208 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:16.314246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1276/2523] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:59:16.317264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1248/2524] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:16 2022] PUT /identity/v3/projects/01912d5797774b7fb29d614d08f02da8/users/78ef5193116f46b3adb1dd188446e4f3/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:16.329317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88711d6-3509-49f7-94ac-c9efdc3f5c84 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:16.329650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88711d6-3509-49f7-94ac-c9efdc3f5c84 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:16.329878 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0ab9-2b6f-41ba-9ab9-433e3243d208 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:16.330006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88711d6-3509-49f7-94ac-c9efdc3f5c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.331739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e12c0ab9-2b6f-41ba-9ab9-433e3243d208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:16.359906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a88711d6-3509-49f7-94ac-c9efdc3f5c84 None None] MFA Rules not processed for user `78ef5193116f46b3adb1dd188446e4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:16.361083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a88711d6-3509-49f7-94ac-c9efdc3f5c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:16.402871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c0ab9-2b6f-41ba-9ab9-433e3243d208 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:16.406752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0f18-b7dc-4b03-b011-6d225cb4fee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:16.407451 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0f18-b7dc-4b03-b011-6d225cb4fee8 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:16.407735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0f18-b7dc-4b03-b011-6d225cb4fee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:16.408015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0f18-b7dc-4b03-b011-6d225cb4fee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.414536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:16.441116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1277/2525] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:16.454384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88711d6-3509-49f7-94ac-c9efdc3f5c84 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:16.456652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a88711d6-3509-49f7-94ac-c9efdc3f5c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:16.489096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de0f18-b7dc-4b03-b011-6d225cb4fee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:16.490549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de0f18-b7dc-4b03-b011-6d225cb4fee8 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:16.493636 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:16.501232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1249/2526] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:59:16.528381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88711d6-3509-49f7-94ac-c9efdc3f5c84 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:16.532362 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137735d-b106-4ae6-9fdc-e71b69f99216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:16.533109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137735d-b106-4ae6-9fdc-e71b69f99216 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:16.533546 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137735d-b106-4ae6-9fdc-e71b69f99216 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:16.534236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137735d-b106-4ae6-9fdc-e71b69f99216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.543886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137735d-b106-4ae6-9fdc-e71b69f99216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:16.545476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137735d-b106-4ae6-9fdc-e71b69f99216 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:16.558017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1278/2527] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:16 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:59:16.704664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0f18-b7dc-4b03-b011-6d225cb4fee8 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:16.714752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0f18-b7dc-4b03-b011-6d225cb4fee8 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:16.720018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:16.720908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:16.721196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:16.721474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] PATH_INFO: `/v3/users/8554488cd89d46d1adf200ed3c33c061` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:16.722711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8554488cd89d46d1adf200ed3c33c061)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:16.724758 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:16.946842 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8554488cd89d46d1adf200ed3c33c061'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:16.954696 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8554488cd89d46d1adf200ed3c33c061'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:17.040683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8554488cd89d46d1adf200ed3c33c061'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:17.041306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8554488cd89d46d1adf200ed3c33c061'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:17.043669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8554488cd89d46d1adf200ed3c33c061'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:17.063930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1250/2528] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:16 2022] DELETE /identity/v3/users/8554488cd89d46d1adf200ed3c33c061 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:17.068655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b604e-b4ec-4a07-b464-384972b1f1f4 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:17.069166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b604e-b4ec-4a07-b464-384972b1f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:17.069349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b604e-b4ec-4a07-b464-384972b1f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:17.088697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-578b604e-b4ec-4a07-b464-384972b1f1f4 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:17.089940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-578b604e-b4ec-4a07-b464-384972b1f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:17.151509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1279/2529] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:59:17.161913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:17.163384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:17.222603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1c860-ac07-4248-885a-a681156813bf admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:17.226266 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc3c33-9899-4521-af5b-74cddea14628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:17.226919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3c33-9899-4521-af5b-74cddea14628 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:17.227206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3c33-9899-4521-af5b-74cddea14628 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:17.227513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3c33-9899-4521-af5b-74cddea14628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:17.238049 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc3c33-9899-4521-af5b-74cddea14628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:17.239580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc3c33-9899-4521-af5b-74cddea14628 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:17.253890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1251/2530] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:17.710336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b604e-b4ec-4a07-b464-384972b1f1f4 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:17.710336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-578b604e-b4ec-4a07-b464-384972b1f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:17.721141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b604e-b4ec-4a07-b464-384972b1f1f4 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:17.726507 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:17.727414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:17.727708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:17.727984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] PATH_INFO: `/v3/projects/24d6b260ac424c83a77239f5004d4058` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:17.729241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d6b260ac424c83a77239f5004d4058)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:17.731165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:17.934243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d6b260ac424c83a77239f5004d4058', 'request_id': 'req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:17.940798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d6b260ac424c83a77239f5004d4058', 'request_id': 'req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:17.946385 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d6b260ac424c83a77239f5004d4058', 'request_id': 'req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:18.092119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] The token cache is being invalidate because project 24d6b260ac424c83a77239f5004d4058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:18.092794 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:18.093064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-cc93ec59-a1df-4b7a-9bd5-8bc0c90f01ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:18.095529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1280/2531] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:17 2022] DELETE /identity/v3/projects/24d6b260ac424c83a77239f5004d4058 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:18.099621 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc3c33-9899-4521-af5b-74cddea14628 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:18.114552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc3c33-9899-4521-af5b-74cddea14628 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:18.117565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08b80-0f50-4bee-b478-079369141ba8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:18.119089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08b80-0f50-4bee-b478-079369141ba8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:18.119755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08b80-0f50-4bee-b478-079369141ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:18.123262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:18.153726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-08e08b80-0f50-4bee-b478-079369141ba8 None None] MFA Rules not processed for user `c4b5d1809aa84059a92a8cd460f06c62`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:18.154949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-08e08b80-0f50-4bee-b478-079369141ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:18.172497 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:18.173382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:18.173660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:18.174090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] PATH_INFO: `/v3/users/78ef5193116f46b3adb1dd188446e4f3` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:18.175373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ef5193116f46b3adb1dd188446e4f3)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:18.178470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:18.205090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:18.227910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1281/2532] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:18.232298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e08b80-0f50-4bee-b478-079369141ba8 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:18.233647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-08e08b80-0f50-4bee-b478-079369141ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:18.247186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e08b80-0f50-4bee-b478-079369141ba8 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:18.252430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309fb86-b706-424a-833f-cf06cf3f49ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:18.253093 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309fb86-b706-424a-833f-cf06cf3f49ba admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:18.253383 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309fb86-b706-424a-833f-cf06cf3f49ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:18.253664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309fb86-b706-424a-833f-cf06cf3f49ba admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:18.254355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309fb86-b706-424a-833f-cf06cf3f49ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:18.256369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309fb86-b706-424a-833f-cf06cf3f49ba admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:18.389439 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1282/2533] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:59:18 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:59:18.394162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309fb86-b706-424a-833f-cf06cf3f49ba admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:18.426235 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ef5193116f46b3adb1dd188446e4f3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:18.434733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ef5193116f46b3adb1dd188446e4f3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:18.457557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309fb86-b706-424a-833f-cf06cf3f49ba admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:18.462375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5576-def8-40e4-815e-6ed6d6386679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:18.463053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5576-def8-40e4-815e-6ed6d6386679 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:18.463341 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5576-def8-40e4-815e-6ed6d6386679 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:18.463654 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5576-def8-40e4-815e-6ed6d6386679 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:18.464354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5576-def8-40e4-815e-6ed6d6386679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:18.466347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5576-def8-40e4-815e-6ed6d6386679 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:18.589375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ef5193116f46b3adb1dd188446e4f3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:18.589987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ef5193116f46b3adb1dd188446e4f3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:18.590589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ef5193116f46b3adb1dd188446e4f3'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:18.610403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1252/2534] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:18 2022] DELETE /identity/v3/users/78ef5193116f46b3adb1dd188446e4f3 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:18.663277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1283/2535] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:59:18 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:59:18.668171 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:18.669096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:18.739948 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd72e57-35b5-4815-8674-bf3c2bb8714a admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:18.744491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569e114-4d20-4490-a2a1-4313db344b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:18.745156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e114-4d20-4490-a2a1-4313db344b27 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:18.745436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e114-4d20-4490-a2a1-4313db344b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:18.745707 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e114-4d20-4490-a2a1-4313db344b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:18.746422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569e114-4d20-4490-a2a1-4313db344b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:18.748131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569e114-4d20-4490-a2a1-4313db344b27 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:18.759181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1253/2536] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:59:18.763446 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5576-def8-40e4-815e-6ed6d6386679 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:18.773515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5576-def8-40e4-815e-6ed6d6386679 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:18.778416 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a168b5-2cd4-4007-b576-188f0fba5e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:18.779305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a168b5-2cd4-4007-b576-188f0fba5e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:18.779640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a168b5-2cd4-4007-b576-188f0fba5e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:18.779968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a168b5-2cd4-4007-b576-188f0fba5e1a admin admin] PATH_INFO: `/v3/projects/94a05a3588294520a9dfeaa2387d1e7d/users/3cc9c314e5194a7f8c419695f7d43a3d/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:18.795878 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a168b5-2cd4-4007-b576-188f0fba5e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a05a3588294520a9dfeaa2387d1e7d, user_id=3cc9c314e5194a7f8c419695f7d43a3d, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:18.799187 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a168b5-2cd4-4007-b576-188f0fba5e1a admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:18.910898 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1284/2537] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:18 2022] PUT /identity/v3/projects/94a05a3588294520a9dfeaa2387d1e7d/users/3cc9c314e5194a7f8c419695f7d43a3d/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:18.915495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569e114-4d20-4490-a2a1-4313db344b27 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:18.927821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569e114-4d20-4490-a2a1-4313db344b27 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:18.963677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:18.992650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67174d13-2c0d-47d0-8ec5-42135631d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:18.993458 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67174d13-2c0d-47d0-8ec5-42135631d345 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:18.998034 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67174d13-2c0d-47d0-8ec5-42135631d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:18.998034 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67174d13-2c0d-47d0-8ec5-42135631d345 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:18.998034 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67174d13-2c0d-47d0-8ec5-42135631d345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:18.998034 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67174d13-2c0d-47d0-8ec5-42135631d345 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:19.008276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1254/2538] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:19.012653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a168b5-2cd4-4007-b576-188f0fba5e1a admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:19.024301 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a168b5-2cd4-4007-b576-188f0fba5e1a admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:19.029509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71262173-0311-4fcd-b3bf-6f2463606ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:19.030439 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71262173-0311-4fcd-b3bf-6f2463606ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:19.030729 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71262173-0311-4fcd-b3bf-6f2463606ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:19.031722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71262173-0311-4fcd-b3bf-6f2463606ad2 admin admin] PATH_INFO: `/v3/projects/94a05a3588294520a9dfeaa2387d1e7d/users/3cc9c314e5194a7f8c419695f7d43a3d/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:19.034227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71262173-0311-4fcd-b3bf-6f2463606ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a05a3588294520a9dfeaa2387d1e7d, user_id=3cc9c314e5194a7f8c419695f7d43a3d, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:19.037052 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71262173-0311-4fcd-b3bf-6f2463606ad2 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:19.053371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1285/2539] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:19 2022] PUT /identity/v3/projects/94a05a3588294520a9dfeaa2387d1e7d/users/3cc9c314e5194a7f8c419695f7d43a3d/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:19.058213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67174d13-2c0d-47d0-8ec5-42135631d345 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:19.058213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-67174d13-2c0d-47d0-8ec5-42135631d345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:19.074270 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67174d13-2c0d-47d0-8ec5-42135631d345 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:19.137872 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:19.138740 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:19.139020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:19.139326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] PATH_INFO: `/v3/projects/01912d5797774b7fb29d614d08f02da8` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:19.141228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01912d5797774b7fb29d614d08f02da8)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:19.143393 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:19.279157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01912d5797774b7fb29d614d08f02da8', 'request_id': 'req-211ddead-4b39-4af8-bb0d-060fee3a30a2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:19.286180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01912d5797774b7fb29d614d08f02da8', 'request_id': 'req-211ddead-4b39-4af8-bb0d-060fee3a30a2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:19.292053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01912d5797774b7fb29d614d08f02da8', 'request_id': 'req-211ddead-4b39-4af8-bb0d-060fee3a30a2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:19.378479 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] The token cache is being invalidate because project 01912d5797774b7fb29d614d08f02da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:19.379492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:19.379492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-211ddead-4b39-4af8-bb0d-060fee3a30a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:19.381402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1255/2540] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:19 2022] DELETE /identity/v3/projects/01912d5797774b7fb29d614d08f02da8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:19.387115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941d652-172c-45d2-b1b5-d9740215a165 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:19.387623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941d652-172c-45d2-b1b5-d9740215a165 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:19.388043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941d652-172c-45d2-b1b5-d9740215a165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:19.408424 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-5941d652-172c-45d2-b1b5-d9740215a165 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:19.409721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-5941d652-172c-45d2-b1b5-d9740215a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:19.486057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1286/2541] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:19.493754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a044f8-1158-44db-898c-6b6ab32886ee None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:19.494866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a044f8-1158-44db-898c-6b6ab32886ee None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:19.494866 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a044f8-1158-44db-898c-6b6ab32886ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:19.513632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-78a044f8-1158-44db-898c-6b6ab32886ee None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:19.514844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-78a044f8-1158-44db-898c-6b6ab32886ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:19.522896 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1256/2542] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:19.527418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941d652-172c-45d2-b1b5-d9740215a165 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:19.538039 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941d652-172c-45d2-b1b5-d9740215a165 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:19.542814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd6879-aaaf-4f1e-a1e0-f7b51241af84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:19.543526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6879-aaaf-4f1e-a1e0-f7b51241af84 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:19.543814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6879-aaaf-4f1e-a1e0-f7b51241af84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:19.544097 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6879-aaaf-4f1e-a1e0-f7b51241af84 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:19.544841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd6879-aaaf-4f1e-a1e0-f7b51241af84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:59:19.545154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd6879-aaaf-4f1e-a1e0-f7b51241af84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:19.547279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd6879-aaaf-4f1e-a1e0-f7b51241af84 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:19.550762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:19.562843 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1287/2543] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:59:19.569490 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a044f8-1158-44db-898c-6b6ab32886ee None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:19.576857 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a044f8-1158-44db-898c-6b6ab32886ee None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:19.581726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7e4a4-5a9a-4865-91de-48958f491412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:19.582384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7e4a4-5a9a-4865-91de-48958f491412 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:19.582669 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7e4a4-5a9a-4865-91de-48958f491412 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:19.582942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7e4a4-5a9a-4865-91de-48958f491412 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:19.583692 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7e4a4-5a9a-4865-91de-48958f491412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:19.585615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7e4a4-5a9a-4865-91de-48958f491412 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:19.690646 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1257/2544] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:59:19 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:19.693842 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd6879-aaaf-4f1e-a1e0-f7b51241af84 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:19.704647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd6879-aaaf-4f1e-a1e0-f7b51241af84 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:19.762788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1750fa-d43c-49de-85ad-1502615c21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:19.763526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1750fa-d43c-49de-85ad-1502615c21b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:19.763811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1750fa-d43c-49de-85ad-1502615c21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:19.764116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1750fa-d43c-49de-85ad-1502615c21b6 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:19.764801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1750fa-d43c-49de-85ad-1502615c21b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:19.767423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1750fa-d43c-49de-85ad-1502615c21b6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:19.870170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1288/2545] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:59:19 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:19.874222 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7e4a4-5a9a-4865-91de-48958f491412 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:19.885465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7e4a4-5a9a-4865-91de-48958f491412 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:19.891789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a723f-476a-4dee-996f-bbb0c99feebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:19.892505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a723f-476a-4dee-996f-bbb0c99feebc admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:19.892789 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a723f-476a-4dee-996f-bbb0c99feebc admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:19.893076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a723f-476a-4dee-996f-bbb0c99feebc admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:19.893809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a723f-476a-4dee-996f-bbb0c99feebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:19.895570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a723f-476a-4dee-996f-bbb0c99feebc admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:19.907389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1258/2546] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:19.911466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1750fa-d43c-49de-85ad-1502615c21b6 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:19.922160 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1750fa-d43c-49de-85ad-1502615c21b6 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:19.927129 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b8c0c-a5a2-4be7-be75-fcb7d4ec92ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:19.927897 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b8c0c-a5a2-4be7-be75-fcb7d4ec92ac admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:19.928189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b8c0c-a5a2-4be7-be75-fcb7d4ec92ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:19.928473 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b8c0c-a5a2-4be7-be75-fcb7d4ec92ac admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:19.929232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b8c0c-a5a2-4be7-be75-fcb7d4ec92ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:19.931168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b8c0c-a5a2-4be7-be75-fcb7d4ec92ac admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:19.944057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1289/2547] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:19.949737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a723f-476a-4dee-996f-bbb0c99feebc admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:19.961210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a723f-476a-4dee-996f-bbb0c99feebc admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:19.966281 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4690c1c-fe33-429f-913e-3e8ccc6902ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:19.967220 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4690c1c-fe33-429f-913e-3e8ccc6902ed admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:19.967541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4690c1c-fe33-429f-913e-3e8ccc6902ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:19.967821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4690c1c-fe33-429f-913e-3e8ccc6902ed admin admin] PATH_INFO: `/v3/projects/b591f7f1598e4793b271fd6c815045a7/users/8a6626ab093f4e54895644c7ec009144/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:19.986797 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4690c1c-fe33-429f-913e-3e8ccc6902ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b591f7f1598e4793b271fd6c815045a7, user_id=8a6626ab093f4e54895644c7ec009144, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:19.989660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4690c1c-fe33-429f-913e-3e8ccc6902ed admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:19.994326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:20.071625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1259/2548] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:19 2022] PUT /identity/v3/projects/b591f7f1598e4793b271fd6c815045a7/users/8a6626ab093f4e54895644c7ec009144/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:20.083043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aa24f-04a0-417c-bb04-4db94ea86a46 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:20.083379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aa24f-04a0-417c-bb04-4db94ea86a46 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:20.083662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aa24f-04a0-417c-bb04-4db94ea86a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:20.112389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-8e1aa24f-04a0-417c-bb04-4db94ea86a46 None None] MFA Rules not processed for user `8a6626ab093f4e54895644c7ec009144`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:20.113683 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-8e1aa24f-04a0-417c-bb04-4db94ea86a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:20.190144 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1290/2549] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:20.194698 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4690c1c-fe33-429f-913e-3e8ccc6902ed admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:20.257190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4690c1c-fe33-429f-913e-3e8ccc6902ed admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:20.261729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce7361-448c-4b97-b327-5c31ad1fd757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:20.262381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce7361-448c-4b97-b327-5c31ad1fd757 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:20.262679 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce7361-448c-4b97-b327-5c31ad1fd757 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:20.262936 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce7361-448c-4b97-b327-5c31ad1fd757 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:20.263649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce7361-448c-4b97-b327-5c31ad1fd757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:20.265672 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce7361-448c-4b97-b327-5c31ad1fd757 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:20.425928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1260/2550] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:59:20 2022] POST /identity/v3/projects => generated 371 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:20.430064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aa24f-04a0-417c-bb04-4db94ea86a46 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:20.441706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aa24f-04a0-417c-bb04-4db94ea86a46 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:20.501562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc406b9-cb47-4a49-8586-eb02f230bf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:20.502248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc406b9-cb47-4a49-8586-eb02f230bf8c admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:20.502530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc406b9-cb47-4a49-8586-eb02f230bf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:20.502827 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc406b9-cb47-4a49-8586-eb02f230bf8c admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:20.503549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc406b9-cb47-4a49-8586-eb02f230bf8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:20.505474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc406b9-cb47-4a49-8586-eb02f230bf8c admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:20.514503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:20.679331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1291/2551] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:59:20 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:20.688589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bad6-d175-4683-8eb9-bbdee18700c7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:20.688589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bad6-d175-4683-8eb9-bbdee18700c7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:20.688589 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bad6-d175-4683-8eb9-bbdee18700c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:20.691334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc406b9-cb47-4a49-8586-eb02f230bf8c admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:20.704354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc406b9-cb47-4a49-8586-eb02f230bf8c admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:20.710448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503400-d89b-4f78-969c-de809e0b7917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:20.711241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503400-d89b-4f78-969c-de809e0b7917 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:20.712016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503400-d89b-4f78-969c-de809e0b7917 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:20.712016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503400-d89b-4f78-969c-de809e0b7917 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:20.712768 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35503400-d89b-4f78-969c-de809e0b7917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:20.714724 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35503400-d89b-4f78-969c-de809e0b7917 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:20.717293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-f606bad6-d175-4683-8eb9-bbdee18700c7 None None] MFA Rules not processed for user `3cc9c314e5194a7f8c419695f7d43a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:20.719189 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f606bad6-d175-4683-8eb9-bbdee18700c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:20.728197 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1292/2552] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:59:20.733499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503400-d89b-4f78-969c-de809e0b7917 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:20.747298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503400-d89b-4f78-969c-de809e0b7917 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:20.752815 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e0c42-345a-49da-b1e0-4055d8a37ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:20.754529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e0c42-345a-49da-b1e0-4055d8a37ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:20.754940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e0c42-345a-49da-b1e0-4055d8a37ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:20.755299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e0c42-345a-49da-b1e0-4055d8a37ae1 admin admin] PATH_INFO: `/v3/projects/8f8bae582f3a4dc5a52cd6dd103f3b27/users/86358fab29b246fdae1c70ad75f63494/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:20.772291 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e0c42-345a-49da-b1e0-4055d8a37ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8bae582f3a4dc5a52cd6dd103f3b27, user_id=86358fab29b246fdae1c70ad75f63494, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:20.775040 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e0c42-345a-49da-b1e0-4055d8a37ae1 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:20.804565 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1261/2553] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:20.818539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606bad6-d175-4683-8eb9-bbdee18700c7 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:20.818539 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f606bad6-d175-4683-8eb9-bbdee18700c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:20.876103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606bad6-d175-4683-8eb9-bbdee18700c7 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:20.880061 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f2f5b-6d61-4ca1-ae70-2cf27394cef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:20.880835 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f2f5b-6d61-4ca1-ae70-2cf27394cef6 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:20.881108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f2f5b-6d61-4ca1-ae70-2cf27394cef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:20.881389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f2f5b-6d61-4ca1-ae70-2cf27394cef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:20.883268 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-703f2f5b-6d61-4ca1-ae70-2cf27394cef6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:20.906693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:20.910277 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1293/2554] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:20 2022] PUT /identity/v3/projects/8f8bae582f3a4dc5a52cd6dd103f3b27/users/86358fab29b246fdae1c70ad75f63494/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:20.914354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e0c42-345a-49da-b1e0-4055d8a37ae1 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:20.946210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f2f5b-6d61-4ca1-ae70-2cf27394cef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:20.947961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f2f5b-6d61-4ca1-ae70-2cf27394cef6 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:20.958227 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1262/2555] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:59:20.980147 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e0c42-345a-49da-b1e0-4055d8a37ae1 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:20.985207 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5fa7e-4dfa-4a4e-9b8b-d56ddcd8120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:20.985883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5fa7e-4dfa-4a4e-9b8b-d56ddcd8120c admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:20.986172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5fa7e-4dfa-4a4e-9b8b-d56ddcd8120c admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:20.986458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5fa7e-4dfa-4a4e-9b8b-d56ddcd8120c admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:20.987193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5fa7e-4dfa-4a4e-9b8b-d56ddcd8120c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:20.988859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5fa7e-4dfa-4a4e-9b8b-d56ddcd8120c admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:21.002745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1294/2556] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 08:59:21.003826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f2f5b-6d61-4ca1-ae70-2cf27394cef6 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:21.016963 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f2f5b-6d61-4ca1-ae70-2cf27394cef6 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:21.026198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37100b-2038-4be9-ad83-78771e7594ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:21.026198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37100b-2038-4be9-ad83-78771e7594ba admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:21.026198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37100b-2038-4be9-ad83-78771e7594ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:21.026198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37100b-2038-4be9-ad83-78771e7594ba admin admin] PATH_INFO: `/v3/projects/8f8bae582f3a4dc5a52cd6dd103f3b27/users/86358fab29b246fdae1c70ad75f63494/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:21.036538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37100b-2038-4be9-ad83-78771e7594ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8bae582f3a4dc5a52cd6dd103f3b27, user_id=86358fab29b246fdae1c70ad75f63494, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:21.036538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37100b-2038-4be9-ad83-78771e7594ba admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:21.042442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1263/2557] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:21 2022] PUT /identity/v3/projects/8f8bae582f3a4dc5a52cd6dd103f3b27/users/86358fab29b246fdae1c70ad75f63494/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 08:59:21.054349 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4121b19-1ea9-4a05-91ac-0d9b57e86b17 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:21.054774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4121b19-1ea9-4a05-91ac-0d9b57e86b17 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:21.055128 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4121b19-1ea9-4a05-91ac-0d9b57e86b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:21.087813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-d4121b19-1ea9-4a05-91ac-0d9b57e86b17 None None] MFA Rules not processed for user `86358fab29b246fdae1c70ad75f63494`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:21.089135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d4121b19-1ea9-4a05-91ac-0d9b57e86b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:21.166480 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1295/2558] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:21.178014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37100b-2038-4be9-ad83-78771e7594ba admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:21.179810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-eb37100b-2038-4be9-ad83-78771e7594ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:21.242517 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37100b-2038-4be9-ad83-78771e7594ba admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:21.246366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84810-5e2d-402c-adcb-1e2660d92642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:21.247020 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84810-5e2d-402c-adcb-1e2660d92642 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:21.247303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84810-5e2d-402c-adcb-1e2660d92642 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:21.247616 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84810-5e2d-402c-adcb-1e2660d92642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:21.257551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb84810-5e2d-402c-adcb-1e2660d92642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:21.258990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb84810-5e2d-402c-adcb-1e2660d92642 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:21.269089 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1264/2559] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:21.511252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4121b19-1ea9-4a05-91ac-0d9b57e86b17 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:21.521967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4121b19-1ea9-4a05-91ac-0d9b57e86b17 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:21.526038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dec467-109f-494f-94fb-81ea7cbf7c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:21.529194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dec467-109f-494f-94fb-81ea7cbf7c8d service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:21.529194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dec467-109f-494f-94fb-81ea7cbf7c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:21.529194 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dec467-109f-494f-94fb-81ea7cbf7c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:21.571241 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:21.590739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dec467-109f-494f-94fb-81ea7cbf7c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:21.592305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dec467-109f-494f-94fb-81ea7cbf7c8d service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:21.601921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1296/2560] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:59:22.788418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84810-5e2d-402c-adcb-1e2660d92642 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:22.797388 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84810-5e2d-402c-adcb-1e2660d92642 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:22.801428 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de0b96-94c4-46a3-988f-8b4cf7d89c97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:22.802072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de0b96-94c4-46a3-988f-8b4cf7d89c97 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:22.804615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de0b96-94c4-46a3-988f-8b4cf7d89c97 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:22.804615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de0b96-94c4-46a3-988f-8b4cf7d89c97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:22.865131 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de0b96-94c4-46a3-988f-8b4cf7d89c97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:22.866569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de0b96-94c4-46a3-988f-8b4cf7d89c97 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:22.876879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1265/2561] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:31.753760 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=10 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:32.782238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dec467-109f-494f-94fb-81ea7cbf7c8d service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:32.788405 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f1dec467-109f-494f-94fb-81ea7cbf7c8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:32.851544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dec467-109f-494f-94fb-81ea7cbf7c8d service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:32.855209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face9a48-30b1-4a56-b43c-d4abbc02a017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:32.855895 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face9a48-30b1-4a56-b43c-d4abbc02a017 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:32.856178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face9a48-30b1-4a56-b43c-d4abbc02a017 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:32.856459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face9a48-30b1-4a56-b43c-d4abbc02a017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:32.858256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-face9a48-30b1-4a56-b43c-d4abbc02a017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:32.871887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=79,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:32.923951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face9a48-30b1-4a56-b43c-d4abbc02a017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:32.925406 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face9a48-30b1-4a56-b43c-d4abbc02a017 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:32.935138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1297/2562] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:33.546390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de0b96-94c4-46a3-988f-8b4cf7d89c97 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:33.548613 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b0de0b96-94c4-46a3-988f-8b4cf7d89c97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:33.563741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de0b96-94c4-46a3-988f-8b4cf7d89c97 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:33.568815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685225b-4338-49fa-a4e3-b58862cb959f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:33.569469 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685225b-4338-49fa-a4e3-b58862cb959f service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:33.569755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685225b-4338-49fa-a4e3-b58862cb959f service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:33.570033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685225b-4338-49fa-a4e3-b58862cb959f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:33.572006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8685225b-4338-49fa-a4e3-b58862cb959f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:33.653827 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685225b-4338-49fa-a4e3-b58862cb959f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:33.655820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685225b-4338-49fa-a4e3-b58862cb959f service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:33.668014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1266/2563] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:59:37.816679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face9a48-30b1-4a56-b43c-d4abbc02a017 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:37.818124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-face9a48-30b1-4a56-b43c-d4abbc02a017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:37.833657 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face9a48-30b1-4a56-b43c-d4abbc02a017 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:37.841624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:37.843431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:37.843787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:37.844115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] PATH_INFO: `/v3/users/b0eb46b0aeeb46fe8dcdb02f29ae4013` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:37.845581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0eb46b0aeeb46fe8dcdb02f29ae4013)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:37.847643 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:38.125798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0eb46b0aeeb46fe8dcdb02f29ae4013'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:38.146380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0eb46b0aeeb46fe8dcdb02f29ae4013'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:38.223824 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0eb46b0aeeb46fe8dcdb02f29ae4013'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:38.232623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0eb46b0aeeb46fe8dcdb02f29ae4013'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:38.234702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-81052143-6c6d-4e7d-8e6d-d10ee896a2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0eb46b0aeeb46fe8dcdb02f29ae4013'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:38.242072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1298/2564] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:37 2022] DELETE /identity/v3/users/b0eb46b0aeeb46fe8dcdb02f29ae4013 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:38.609912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685225b-4338-49fa-a4e3-b58862cb959f service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:38.620349 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685225b-4338-49fa-a4e3-b58862cb959f service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:38.702960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:38.703863 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:38.704147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:38.704430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] PATH_INFO: `/v3/projects/b493dbf75ed64a7dbda3e9c6a6168f8f` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:38.705783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b493dbf75ed64a7dbda3e9c6a6168f8f)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:38.708156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:38.818917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'request_id': 'req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:38.825389 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'request_id': 'req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:38.832818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b493dbf75ed64a7dbda3e9c6a6168f8f', 'request_id': 'req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:38.926510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] The token cache is being invalidate because project b493dbf75ed64a7dbda3e9c6a6168f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:38.926510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:38.927165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0dd1bfc2-2d57-4761-80b9-616e8c2c3280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:38.928846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1267/2565] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:38 2022] DELETE /identity/v3/projects/b493dbf75ed64a7dbda3e9c6a6168f8f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:38.934375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277fec7-c3d8-446d-9070-3115fd51292a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:38.934901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277fec7-c3d8-446d-9070-3115fd51292a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:38.935002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277fec7-c3d8-446d-9070-3115fd51292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:38.954709 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-d277fec7-c3d8-446d-9070-3115fd51292a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:38.956081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d277fec7-c3d8-446d-9070-3115fd51292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:38.976691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:39.016679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1299/2566] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:39.025289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07396e-c395-47af-988d-2f2427ed425d None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.025492 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07396e-c395-47af-988d-2f2427ed425d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.025788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07396e-c395-47af-988d-2f2427ed425d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.045065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5e07396e-c395-47af-988d-2f2427ed425d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:39.046790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5e07396e-c395-47af-988d-2f2427ed425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:39.055067 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1268/2567] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:39.059812 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277fec7-c3d8-446d-9070-3115fd51292a None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:39.070479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277fec7-c3d8-446d-9070-3115fd51292a None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:39.075034 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096bbf-6200-477e-8441-c1b09b8c6246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:39.075720 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096bbf-6200-477e-8441-c1b09b8c6246 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.076004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096bbf-6200-477e-8441-c1b09b8c6246 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.076286 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096bbf-6200-477e-8441-c1b09b8c6246 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.077024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096bbf-6200-477e-8441-c1b09b8c6246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:59:39.080498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096bbf-6200-477e-8441-c1b09b8c6246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:39.080498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096bbf-6200-477e-8441-c1b09b8c6246 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:39.090484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1300/2568] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:59:39.095068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07396e-c395-47af-988d-2f2427ed425d None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:39.105960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07396e-c395-47af-988d-2f2427ed425d None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:39.112017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567cd88-3f36-4b98-9ff1-ae342a88b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:39.112791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567cd88-3f36-4b98-9ff1-ae342a88b7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.112982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567cd88-3f36-4b98-9ff1-ae342a88b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.113261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567cd88-3f36-4b98-9ff1-ae342a88b7c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.114232 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567cd88-3f36-4b98-9ff1-ae342a88b7c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:39.116099 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567cd88-3f36-4b98-9ff1-ae342a88b7c0 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:39.131928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:39.203318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1269/2569] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:59:39 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:39.207168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096bbf-6200-477e-8441-c1b09b8c6246 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:39.219794 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096bbf-6200-477e-8441-c1b09b8c6246 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:39.288342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647a6a7-f8df-48ee-87dd-e48143219030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:39.289281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647a6a7-f8df-48ee-87dd-e48143219030 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.289727 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647a6a7-f8df-48ee-87dd-e48143219030 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.290178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647a6a7-f8df-48ee-87dd-e48143219030 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.291535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647a6a7-f8df-48ee-87dd-e48143219030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:39.293530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647a6a7-f8df-48ee-87dd-e48143219030 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:39.391395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1301/2570] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:59:39 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 08:59:39.393311 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567cd88-3f36-4b98-9ff1-ae342a88b7c0 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:39.403699 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567cd88-3f36-4b98-9ff1-ae342a88b7c0 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:39.408970 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22918327-9687-4782-9740-9627fa61255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:39.409631 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22918327-9687-4782-9740-9627fa61255c admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.409935 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22918327-9687-4782-9740-9627fa61255c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.410188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22918327-9687-4782-9740-9627fa61255c admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.410905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22918327-9687-4782-9740-9627fa61255c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:39.412523 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22918327-9687-4782-9740-9627fa61255c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:39.423807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1270/2571] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:39.428169 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647a6a7-f8df-48ee-87dd-e48143219030 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:39.439221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647a6a7-f8df-48ee-87dd-e48143219030 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:39.448447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3357d-ca7b-4433-8dc0-8513a5c259e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:39.448447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3357d-ca7b-4433-8dc0-8513a5c259e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.448447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3357d-ca7b-4433-8dc0-8513a5c259e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.448447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3357d-ca7b-4433-8dc0-8513a5c259e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.448801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3357d-ca7b-4433-8dc0-8513a5c259e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:39.448801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3357d-ca7b-4433-8dc0-8513a5c259e5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:39.467110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1302/2572] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:39.476023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22918327-9687-4782-9740-9627fa61255c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:39.488365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22918327-9687-4782-9740-9627fa61255c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:39.498399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019f629-0cfd-40fe-b047-ac103be33925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:39.499447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019f629-0cfd-40fe-b047-ac103be33925 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.499732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019f629-0cfd-40fe-b047-ac103be33925 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.500010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019f629-0cfd-40fe-b047-ac103be33925 admin admin] PATH_INFO: `/v3/projects/f0964a125c554efe858f7695016de8db/users/449850e1f8d144eb8b330a764882a099/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.516366 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019f629-0cfd-40fe-b047-ac103be33925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0964a125c554efe858f7695016de8db, user_id=449850e1f8d144eb8b330a764882a099, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:39.519051 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019f629-0cfd-40fe-b047-ac103be33925 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:39.624194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1271/2573] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:39 2022] PUT /identity/v3/projects/f0964a125c554efe858f7695016de8db/users/449850e1f8d144eb8b330a764882a099/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:39.629230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a869bd2-8745-4f8a-9e7c-1dd541d28d21 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.629594 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a869bd2-8745-4f8a-9e7c-1dd541d28d21 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.630056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a869bd2-8745-4f8a-9e7c-1dd541d28d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.630487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019f629-0cfd-40fe-b047-ac103be33925 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:39.632223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3019f629-0cfd-40fe-b047-ac103be33925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:39.648451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3a869bd2-8745-4f8a-9e7c-1dd541d28d21 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:39.649714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3a869bd2-8745-4f8a-9e7c-1dd541d28d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:39.695966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019f629-0cfd-40fe-b047-ac103be33925 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:39.699718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2e6e4-44d2-4fa6-8370-2eb0c7722a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:39.700381 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2e6e4-44d2-4fa6-8370-2eb0c7722a0e service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.700664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2e6e4-44d2-4fa6-8370-2eb0c7722a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.700941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2e6e4-44d2-4fa6-8370-2eb0c7722a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.703656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1dd2e6e4-44d2-4fa6-8370-2eb0c7722a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:39.718846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1303/2574] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:39.732631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a869bd2-8745-4f8a-9e7c-1dd541d28d21 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:39.743926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a869bd2-8745-4f8a-9e7c-1dd541d28d21 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:39.747981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5dae1-0b13-43a6-a700-54d852ee6ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:39.748646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5dae1-0b13-43a6-a700-54d852ee6ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:39.749039 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5dae1-0b13-43a6-a700-54d852ee6ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:39.749329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5dae1-0b13-43a6-a700-54d852ee6ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:39.759458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5dae1-0b13-43a6-a700-54d852ee6ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:39.760943 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5dae1-0b13-43a6-a700-54d852ee6ed0 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:39.770852 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2e6e4-44d2-4fa6-8370-2eb0c7722a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:39.771746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1304/2575] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:59:39.772352 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2e6e4-44d2-4fa6-8370-2eb0c7722a0e service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:39.783283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1272/2576] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 08:59:41.678238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5dae1-0b13-43a6-a700-54d852ee6ed0 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:41.682201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c0f5dae1-0b13-43a6-a700-54d852ee6ed0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:41.699049 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5dae1-0b13-43a6-a700-54d852ee6ed0 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:41.706871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:41.708217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:41.708570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:41.709096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] PATH_INFO: `/v3/users/c4b5d1809aa84059a92a8cd460f06c62` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:41.710680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b5d1809aa84059a92a8cd460f06c62)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:41.713632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:41.733962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:41.881012 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b5d1809aa84059a92a8cd460f06c62'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:41.898172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b5d1809aa84059a92a8cd460f06c62'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:41.950457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b5d1809aa84059a92a8cd460f06c62'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:41.964289 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b5d1809aa84059a92a8cd460f06c62'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:41.965195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b5d1809aa84059a92a8cd460f06c62'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:41.976910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1305/2577] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:41 2022] DELETE /identity/v3/users/c4b5d1809aa84059a92a8cd460f06c62 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:42.444553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2e6e4-44d2-4fa6-8370-2eb0c7722a0e service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:42.454990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2e6e4-44d2-4fa6-8370-2eb0c7722a0e service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:42.543588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:42.544571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:42.545151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:42.545447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] PATH_INFO: `/v3/projects/89bcba80fc484ad88fb54bd14b1b4339` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:42.548184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89bcba80fc484ad88fb54bd14b1b4339)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:42.562120 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:42.564674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:42.712348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89bcba80fc484ad88fb54bd14b1b4339', 'request_id': 'req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:42.723036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89bcba80fc484ad88fb54bd14b1b4339', 'request_id': 'req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:42.732372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89bcba80fc484ad88fb54bd14b1b4339', 'request_id': 'req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:42.862554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] The token cache is being invalidate because project 89bcba80fc484ad88fb54bd14b1b4339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:42.862983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:42.864088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:42.869024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1273/2578] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:42 2022] DELETE /identity/v3/projects/89bcba80fc484ad88fb54bd14b1b4339 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:42.870611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:42.872986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:42.889472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc0ad7-7dd0-451a-b1fa-522832760cd5 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:42.964509 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:42.965573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:42.969514 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:42.970393 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] PATH_INFO: `/v3/users/3cc9c314e5194a7f8c419695f7d43a3d` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:42.972372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc9c314e5194a7f8c419695f7d43a3d)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:42.975533 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:43.243991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc9c314e5194a7f8c419695f7d43a3d'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:43.268313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc9c314e5194a7f8c419695f7d43a3d'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:43.339722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc9c314e5194a7f8c419695f7d43a3d'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:43.349276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc9c314e5194a7f8c419695f7d43a3d'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:43.350150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-2ab7bc56-9c96-4bd9-acca-fbd5b6be6c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc9c314e5194a7f8c419695f7d43a3d'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:43.357400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1306/2579] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:42 2022] DELETE /identity/v3/users/3cc9c314e5194a7f8c419695f7d43a3d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:43.889820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:43.892108 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:43.922499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbe39c-2eaf-4c16-8bb5-671b1ca3bd9e admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:44.007399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:44.012191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:44.012191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:44.012191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] PATH_INFO: `/v3/projects/94a05a3588294520a9dfeaa2387d1e7d` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:44.012191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a05a3588294520a9dfeaa2387d1e7d)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:44.013319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:44.135314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a05a3588294520a9dfeaa2387d1e7d', 'request_id': 'req-08c3ec32-0215-477b-b217-d0573a3a367f'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.154734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a05a3588294520a9dfeaa2387d1e7d', 'request_id': 'req-08c3ec32-0215-477b-b217-d0573a3a367f'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.181382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a05a3588294520a9dfeaa2387d1e7d', 'request_id': 'req-08c3ec32-0215-477b-b217-d0573a3a367f'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.326999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] The token cache is being invalidate because project 94a05a3588294520a9dfeaa2387d1e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:44.327458 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.328143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-08c3ec32-0215-477b-b217-d0573a3a367f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:44.330416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1274/2580] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:43 2022] DELETE /identity/v3/projects/94a05a3588294520a9dfeaa2387d1e7d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:44.335566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebea4b-d897-4eb9-b2e5-e32a551663a0 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:44.336105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebea4b-d897-4eb9-b2e5-e32a551663a0 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:44.336105 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebea4b-d897-4eb9-b2e5-e32a551663a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:44.363650 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-bdebea4b-d897-4eb9-b2e5-e32a551663a0 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:44.364953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-bdebea4b-d897-4eb9-b2e5-e32a551663a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:44.390363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:44.532317 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1307/2581] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:44.540181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629ae8-4781-4d21-b7cc-afe6c9f384f1 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:44.540477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629ae8-4781-4d21-b7cc-afe6c9f384f1 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:44.540762 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629ae8-4781-4d21-b7cc-afe6c9f384f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:44.583042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-7d629ae8-4781-4d21-b7cc-afe6c9f384f1 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:44.585248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-7d629ae8-4781-4d21-b7cc-afe6c9f384f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:44.621752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1275/2582] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:44.626196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebea4b-d897-4eb9-b2e5-e32a551663a0 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:44.650771 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebea4b-d897-4eb9-b2e5-e32a551663a0 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:44.668829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192642f-a505-49c5-b72d-c6a527bb43f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:44.669550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192642f-a505-49c5-b72d-c6a527bb43f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:44.669855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192642f-a505-49c5-b72d-c6a527bb43f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:44.670120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192642f-a505-49c5-b72d-c6a527bb43f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:44.671451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192642f-a505-49c5-b72d-c6a527bb43f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 08:59:44.671979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192642f-a505-49c5-b72d-c6a527bb43f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:44.673849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192642f-a505-49c5-b72d-c6a527bb43f6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:44.710712 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1308/2583] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 08:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 08:59:44.715889 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629ae8-4781-4d21-b7cc-afe6c9f384f1 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:44.729300 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629ae8-4781-4d21-b7cc-afe6c9f384f1 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:44.740748 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64288a01-c39e-42fc-b49a-11ba31a954ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:44.742523 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288a01-c39e-42fc-b49a-11ba31a954ea admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:44.744834 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288a01-c39e-42fc-b49a-11ba31a954ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:44.747714 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288a01-c39e-42fc-b49a-11ba31a954ea admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:44.749239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64288a01-c39e-42fc-b49a-11ba31a954ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:44.756815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64288a01-c39e-42fc-b49a-11ba31a954ea admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:44.893351 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1276/2584] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 08:59:44 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:44.894182 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192642f-a505-49c5-b72d-c6a527bb43f6 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:44.907143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192642f-a505-49c5-b72d-c6a527bb43f6 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:45.067907 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a848e5-0dc0-4ff8-bf66-e03d0d164675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:45.102562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a848e5-0dc0-4ff8-bf66-e03d0d164675 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:45.102562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a848e5-0dc0-4ff8-bf66-e03d0d164675 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:45.102562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a848e5-0dc0-4ff8-bf66-e03d0d164675 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:45.102562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a848e5-0dc0-4ff8-bf66-e03d0d164675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:45.102562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a848e5-0dc0-4ff8-bf66-e03d0d164675 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:45.460788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1309/2585] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 08:59:44 2022] POST /identity/v3/users => generated 292 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 08:59:45.464869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64288a01-c39e-42fc-b49a-11ba31a954ea admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:45.472330 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:45.482257 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64288a01-c39e-42fc-b49a-11ba31a954ea admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:45.502519 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b30ff-9765-4d0c-aed9-1410c974d690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:45.503237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b30ff-9765-4d0c-aed9-1410c974d690 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:45.503559 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b30ff-9765-4d0c-aed9-1410c974d690 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:45.503850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b30ff-9765-4d0c-aed9-1410c974d690 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:45.504608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b30ff-9765-4d0c-aed9-1410c974d690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:45.506769 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b30ff-9765-4d0c-aed9-1410c974d690 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:45.529437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1277/2586] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:45.533151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a848e5-0dc0-4ff8-bf66-e03d0d164675 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:45.549885 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a848e5-0dc0-4ff8-bf66-e03d0d164675 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:45.557904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a36c29-4fda-4381-8cee-ebd0b069c3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:45.564454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a36c29-4fda-4381-8cee-ebd0b069c3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:45.564987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a36c29-4fda-4381-8cee-ebd0b069c3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:45.578122 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a36c29-4fda-4381-8cee-ebd0b069c3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:45.579196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a36c29-4fda-4381-8cee-ebd0b069c3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:45.586846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a36c29-4fda-4381-8cee-ebd0b069c3f3 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:45.610193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1310/2587] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 08:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 08:59:45.613980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b30ff-9765-4d0c-aed9-1410c974d690 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:45.634140 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b30ff-9765-4d0c-aed9-1410c974d690 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:45.640538 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee38be-51a0-4c97-860b-484c175664c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:45.641571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee38be-51a0-4c97-860b-484c175664c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:45.641858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee38be-51a0-4c97-860b-484c175664c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:45.642138 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee38be-51a0-4c97-860b-484c175664c3 admin admin] PATH_INFO: `/v3/projects/9ee5efbcdaa74f1f8a430a2866a091b4/users/0931d32bb0634aaa8dac22c47a40b9a9/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:45.679657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee38be-51a0-4c97-860b-484c175664c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee5efbcdaa74f1f8a430a2866a091b4, user_id=0931d32bb0634aaa8dac22c47a40b9a9, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:45.684048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee38be-51a0-4c97-860b-484c175664c3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:45.799405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1278/2588] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 08:59:45 2022] PUT /identity/v3/projects/9ee5efbcdaa74f1f8a430a2866a091b4/users/0931d32bb0634aaa8dac22c47a40b9a9/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:45.817041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0328d9-0911-44e7-9ac5-76c33e568226 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:45.817330 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0328d9-0911-44e7-9ac5-76c33e568226 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:45.817599 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0328d9-0911-44e7-9ac5-76c33e568226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:45.861515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3c0328d9-0911-44e7-9ac5-76c33e568226 None None] MFA Rules not processed for user `0931d32bb0634aaa8dac22c47a40b9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:45.875518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3c0328d9-0911-44e7-9ac5-76c33e568226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:45.982790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1311/2589] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:45.993045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee38be-51a0-4c97-860b-484c175664c3 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:45.995150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b0ee38be-51a0-4c97-860b-484c175664c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:46.151109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee38be-51a0-4c97-860b-484c175664c3 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:46.168096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9da7b2-ea2c-44d0-bfb9-c3e2cf890ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:46.171567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9da7b2-ea2c-44d0-bfb9-c3e2cf890ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:46.171567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9da7b2-ea2c-44d0-bfb9-c3e2cf890ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:46.171567 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9da7b2-ea2c-44d0-bfb9-c3e2cf890ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:46.198664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9da7b2-ea2c-44d0-bfb9-c3e2cf890ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:46.200181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9da7b2-ea2c-44d0-bfb9-c3e2cf890ec4 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:46.235011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1279/2590] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:46.263937 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0328d9-0911-44e7-9ac5-76c33e568226 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:46.326053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:46.493943 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0328d9-0911-44e7-9ac5-76c33e568226 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:46.506834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:46.507983 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:46.508274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:46.508550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] PATH_INFO: `/v3/users/0931d32bb0634aaa8dac22c47a40b9a9` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:46.511411 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0931d32bb0634aaa8dac22c47a40b9a9)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:46.513367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:46.842367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0931d32bb0634aaa8dac22c47a40b9a9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:46.895661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0931d32bb0634aaa8dac22c47a40b9a9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:47.023516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0931d32bb0634aaa8dac22c47a40b9a9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:47.033058 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0931d32bb0634aaa8dac22c47a40b9a9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:47.033839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0931d32bb0634aaa8dac22c47a40b9a9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:47.045231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1312/2591] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:46 2022] DELETE /identity/v3/users/0931d32bb0634aaa8dac22c47a40b9a9 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:47.050961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ec55-296a-4ffd-8e46-fa3a060d6269 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:47.051546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ec55-296a-4ffd-8e46-fa3a060d6269 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:47.051546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ec55-296a-4ffd-8e46-fa3a060d6269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:47.077780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c2f2ec55-296a-4ffd-8e46-fa3a060d6269 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:47.079467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c2f2ec55-296a-4ffd-8e46-fa3a060d6269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:47.164319 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1280/2592] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:47.177346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:47.178662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:47.241411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80394de-41af-4b60-886b-35a72ab9d8ad None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:47.241712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80394de-41af-4b60-886b-35a72ab9d8ad None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:47.242025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80394de-41af-4b60-886b-35a72ab9d8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:47.284433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c80394de-41af-4b60-886b-35a72ab9d8ad None None] MFA Rules not processed for user `449850e1f8d144eb8b330a764882a099`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:47.286744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c80394de-41af-4b60-886b-35a72ab9d8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:47.290378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fa244-d20c-4cc3-bc56-84fb24885839 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:47.300002 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb662fe-dba4-44fe-b85b-5e83da48f69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:47.300898 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb662fe-dba4-44fe-b85b-5e83da48f69b service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:47.301391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb662fe-dba4-44fe-b85b-5e83da48f69b service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:47.301851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb662fe-dba4-44fe-b85b-5e83da48f69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:47.317055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb662fe-dba4-44fe-b85b-5e83da48f69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:47.318813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb662fe-dba4-44fe-b85b-5e83da48f69b service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:47.337417 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1313/2593] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:47.394322 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:47.400525 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1281/2594] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 08:59:47.418065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb662fe-dba4-44fe-b85b-5e83da48f69b service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:47.419121 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2cb662fe-dba4-44fe-b85b-5e83da48f69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:47.523222 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:47.613887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb662fe-dba4-44fe-b85b-5e83da48f69b service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:47.639426 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c24ee-290c-4d0e-80ff-3da49fb480f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:47.646603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c24ee-290c-4d0e-80ff-3da49fb480f0 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:47.646603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c24ee-290c-4d0e-80ff-3da49fb480f0 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:47.646603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c24ee-290c-4d0e-80ff-3da49fb480f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:47.659488 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c24ee-290c-4d0e-80ff-3da49fb480f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:47.662667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c24ee-290c-4d0e-80ff-3da49fb480f0 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:47.704850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1314/2595] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 08:59:48.042593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80394de-41af-4b60-886b-35a72ab9d8ad None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:48.044054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c80394de-41af-4b60-886b-35a72ab9d8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:48.062730 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80394de-41af-4b60-886b-35a72ab9d8ad None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:48.069447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:48.070927 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:48.071607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:48.072048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] PATH_INFO: `/v3/projects/9ee5efbcdaa74f1f8a430a2866a091b4` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:48.073701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee5efbcdaa74f1f8a430a2866a091b4)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:48.076050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:48.273193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee5efbcdaa74f1f8a430a2866a091b4', 'request_id': 'req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:48.287065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee5efbcdaa74f1f8a430a2866a091b4', 'request_id': 'req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:48.298328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee5efbcdaa74f1f8a430a2866a091b4', 'request_id': 'req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:48.423190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] The token cache is being invalidate because project 9ee5efbcdaa74f1f8a430a2866a091b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:48.423509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:48.424210 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-cc5a440b-8f4d-4a08-8b95-79ee8df1443e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:48.426062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1282/2596] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:48 2022] DELETE /identity/v3/projects/9ee5efbcdaa74f1f8a430a2866a091b4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:50.637262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c24ee-290c-4d0e-80ff-3da49fb480f0 service nova] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:50.638623 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-283c24ee-290c-4d0e-80ff-3da49fb480f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:50.659631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c24ee-290c-4d0e-80ff-3da49fb480f0 service nova] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:50.746138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:50.747189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:50.747512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:50.747796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] PATH_INFO: `/v3/users/fec25ac241c94d4dbebb361c55f10f75` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:50.749963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec25ac241c94d4dbebb361c55f10f75)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:50.752495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:51.033484 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec25ac241c94d4dbebb361c55f10f75'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:51.047396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec25ac241c94d4dbebb361c55f10f75'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:51.166425 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec25ac241c94d4dbebb361c55f10f75'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:51.176010 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec25ac241c94d4dbebb361c55f10f75'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:51.176859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec25ac241c94d4dbebb361c55f10f75'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:51.183808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1315/2597] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:50 2022] DELETE /identity/v3/users/fec25ac241c94d4dbebb361c55f10f75 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:51.242325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb52ef-2ed5-4c8e-a1ec-f3f2d976d52d None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:51.242788 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb52ef-2ed5-4c8e-a1ec-f3f2d976d52d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:51.242888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb52ef-2ed5-4c8e-a1ec-f3f2d976d52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:51.262716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-6feb52ef-2ed5-4c8e-a1ec-f3f2d976d52d None None] MFA Rules not processed for user `449850e1f8d144eb8b330a764882a099`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 08:59:51.263996 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-6feb52ef-2ed5-4c8e-a1ec-f3f2d976d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:51.355739 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1283/2598] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 08:59:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 08:59:51.468459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:51.473881 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:51.527471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:51.567016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86f69-e50a-47d5-aeb1-6d6391155cd3 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:51.575452 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:51.576498 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:51.577226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:51.577585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] PATH_INFO: `/v3/projects/7e69cf14c3c8482fbf95620efe1bee1d` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:51.579132 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e69cf14c3c8482fbf95620efe1bee1d)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:51.581293 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:51.750502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e69cf14c3c8482fbf95620efe1bee1d', 'request_id': 'req-801f827e-59fa-4690-a7f9-1fc160cc83ff'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:51.758515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e69cf14c3c8482fbf95620efe1bee1d', 'request_id': 'req-801f827e-59fa-4690-a7f9-1fc160cc83ff'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:51.769242 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e69cf14c3c8482fbf95620efe1bee1d', 'request_id': 'req-801f827e-59fa-4690-a7f9-1fc160cc83ff'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:51.859067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] The token cache is being invalidate because project 7e69cf14c3c8482fbf95620efe1bee1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:51.859067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:51.859067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:51.859067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1316/2599] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:51 2022] DELETE /identity/v3/projects/7e69cf14c3c8482fbf95620efe1bee1d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:51.859874 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb52ef-2ed5-4c8e-a1ec-f3f2d976d52d None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:51.871846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb52ef-2ed5-4c8e-a1ec-f3f2d976d52d None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:51.939849 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:51.941702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:51.941702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:51.941702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] PATH_INFO: `/v3/users/fe2ef5a0f3b247c28929b28e03dace2d` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:51.943850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2ef5a0f3b247c28929b28e03dace2d)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:51.945809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:52.202460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:52.231635 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2ef5a0f3b247c28929b28e03dace2d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:52.240223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2ef5a0f3b247c28929b28e03dace2d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:52.320387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2ef5a0f3b247c28929b28e03dace2d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:52.321438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2ef5a0f3b247c28929b28e03dace2d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:52.322057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2ef5a0f3b247c28929b28e03dace2d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:52.342972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1284/2600] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 08:59:51 2022] DELETE /identity/v3/users/fe2ef5a0f3b247c28929b28e03dace2d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:52.646965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:52.648514 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:52.664940 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f827e-59fa-4690-a7f9-1fc160cc83ff admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:52.733571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:52.734465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:52.734762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:52.735151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] PATH_INFO: `/v3/projects/cdb8e007017448af89eb5c73a839740d` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:52.736380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb8e007017448af89eb5c73a839740d)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:52.738409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:52.875998 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb8e007017448af89eb5c73a839740d', 'request_id': 'req-55268332-20a8-4edb-a46c-8986e38ad601'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:52.882260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb8e007017448af89eb5c73a839740d', 'request_id': 'req-55268332-20a8-4edb-a46c-8986e38ad601'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:52.887901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb8e007017448af89eb5c73a839740d', 'request_id': 'req-55268332-20a8-4edb-a46c-8986e38ad601'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:52.890564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 08:59:53.005734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] The token cache is being invalidate because project cdb8e007017448af89eb5c73a839740d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 08:59:53.006144 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:53.006791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 08:59:53.008669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1317/2601] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 08:59:52 2022] DELETE /identity/v3/projects/cdb8e007017448af89eb5c73a839740d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 08:59:54.629368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 08:59:54.630806 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:54.703170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97a631-2541-417a-80e8-545bb5ef5f25 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 08:59:54.769225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778112ab-530b-4002-b99f-03068f0f3f1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 08:59:54.769934 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778112ab-530b-4002-b99f-03068f0f3f1e service placement] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 08:59:54.770226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778112ab-530b-4002-b99f-03068f0f3f1e service placement] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 08:59:54.770526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778112ab-530b-4002-b99f-03068f0f3f1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 08:59:54.772303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-778112ab-530b-4002-b99f-03068f0f3f1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 08:59:54.784152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778112ab-530b-4002-b99f-03068f0f3f1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 08:59:54.785757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778112ab-530b-4002-b99f-03068f0f3f1e service placement] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 08:59:54.797221 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1285/2602] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 08:59:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:03.244783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:04.792039 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=76,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:10.072408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:10.074453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:10.151076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55268332-20a8-4edb-a46c-8986e38ad601 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:10.156443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:10.157345 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:10.157626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:10.157904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] PATH_INFO: `/v3/users/8a6626ab093f4e54895644c7ec009144` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:10.159123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a6626ab093f4e54895644c7ec009144)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:10.161116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:10.346318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a6626ab093f4e54895644c7ec009144'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:10.359302 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a6626ab093f4e54895644c7ec009144'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:10.434711 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a6626ab093f4e54895644c7ec009144'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:10.444513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a6626ab093f4e54895644c7ec009144'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:10.445450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a6626ab093f4e54895644c7ec009144'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:10.453081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1318/2603] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:10 2022] DELETE /identity/v3/users/8a6626ab093f4e54895644c7ec009144 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:10.457700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de813ab1-5cc7-4c44-b20f-f16ec4b089f6 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:10.458166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de813ab1-5cc7-4c44-b20f-f16ec4b089f6 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:10.458363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de813ab1-5cc7-4c44-b20f-f16ec4b089f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:10.478891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-de813ab1-5cc7-4c44-b20f-f16ec4b089f6 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:10.480385 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-de813ab1-5cc7-4c44-b20f-f16ec4b089f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:10.544155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1286/2604] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 09:00:10.555887 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:10.557375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:10.617713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80707ae-bf85-478c-aac7-59365822262b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:10.621231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bfb10-d6e4-401b-b848-fde96e8ba841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:10.621882 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bfb10-d6e4-401b-b848-fde96e8ba841 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:10.622164 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bfb10-d6e4-401b-b848-fde96e8ba841 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:10.622437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bfb10-d6e4-401b-b848-fde96e8ba841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:10.632957 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bfb10-d6e4-401b-b848-fde96e8ba841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:10.634401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bfb10-d6e4-401b-b848-fde96e8ba841 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:10.645506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1319/2605] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:11.339053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de813ab1-5cc7-4c44-b20f-f16ec4b089f6 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:11.340516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-de813ab1-5cc7-4c44-b20f-f16ec4b089f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:11.353535 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de813ab1-5cc7-4c44-b20f-f16ec4b089f6 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:11.358346 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:11.359237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:11.359544 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:11.359856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] PATH_INFO: `/v3/projects/b591f7f1598e4793b271fd6c815045a7` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:11.361117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b591f7f1598e4793b271fd6c815045a7)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:11.363047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:11.483181 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b591f7f1598e4793b271fd6c815045a7', 'request_id': 'req-04a0d349-3373-4efa-b47e-57faac73716c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:11.490550 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b591f7f1598e4793b271fd6c815045a7', 'request_id': 'req-04a0d349-3373-4efa-b47e-57faac73716c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:11.496913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b591f7f1598e4793b271fd6c815045a7', 'request_id': 'req-04a0d349-3373-4efa-b47e-57faac73716c'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:11.583387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] The token cache is being invalidate because project b591f7f1598e4793b271fd6c815045a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:11.583683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:11.584308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:11.585858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1287/2606] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:11 2022] DELETE /identity/v3/projects/b591f7f1598e4793b271fd6c815045a7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:11.590066 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bfb10-d6e4-401b-b848-fde96e8ba841 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:11.600956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bfb10-d6e4-401b-b848-fde96e8ba841 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:11.619726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:11.659221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:11.660127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:11.660410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:11.660688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] PATH_INFO: `/v3/users/86358fab29b246fdae1c70ad75f63494` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:11.662109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86358fab29b246fdae1c70ad75f63494)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:11.664086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:11.841854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86358fab29b246fdae1c70ad75f63494'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:11.853511 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86358fab29b246fdae1c70ad75f63494'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:11.920282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86358fab29b246fdae1c70ad75f63494'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:11.927781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86358fab29b246fdae1c70ad75f63494'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:11.928447 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-563d4a5b-b3e1-4afc-a361-9fbd04e8fac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86358fab29b246fdae1c70ad75f63494'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:11.934580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1320/2607] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:11 2022] DELETE /identity/v3/users/86358fab29b246fdae1c70ad75f63494 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:12.333102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:12.334505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:12.350038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d349-3373-4efa-b47e-57faac73716c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:12.413659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:12.414628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:12.414911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:12.415196 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] PATH_INFO: `/v3/projects/8f8bae582f3a4dc5a52cd6dd103f3b27` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:12.416478 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8bae582f3a4dc5a52cd6dd103f3b27)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:12.418414 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:12.517949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:12.535161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8bae582f3a4dc5a52cd6dd103f3b27', 'request_id': 'req-3b198942-f62a-46d2-a7fc-be57b50de4ab'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:12.541434 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8bae582f3a4dc5a52cd6dd103f3b27', 'request_id': 'req-3b198942-f62a-46d2-a7fc-be57b50de4ab'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:12.547771 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8bae582f3a4dc5a52cd6dd103f3b27', 'request_id': 'req-3b198942-f62a-46d2-a7fc-be57b50de4ab'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:12.627309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] The token cache is being invalidate because project 8f8bae582f3a4dc5a52cd6dd103f3b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:12.627760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:12.628828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3b198942-f62a-46d2-a7fc-be57b50de4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:12.630548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1288/2608] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:12 2022] DELETE /identity/v3/projects/8f8bae582f3a4dc5a52cd6dd103f3b27 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:12.635558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b3106-d7a8-4c2e-8a35-f0c1b954532f None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:12.636024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b3106-d7a8-4c2e-8a35-f0c1b954532f None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:12.637016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b3106-d7a8-4c2e-8a35-f0c1b954532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:12.656648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-e10b3106-d7a8-4c2e-8a35-f0c1b954532f None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:12.657852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e10b3106-d7a8-4c2e-8a35-f0c1b954532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:12.718632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1321/2609] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:12.726472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92500887-82e1-42c3-a6e6-45fef424e079 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:12.726765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92500887-82e1-42c3-a6e6-45fef424e079 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:12.727077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92500887-82e1-42c3-a6e6-45fef424e079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:12.746804 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-92500887-82e1-42c3-a6e6-45fef424e079 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:12.748120 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-92500887-82e1-42c3-a6e6-45fef424e079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:12.757829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1289/2610] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:12.762379 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b3106-d7a8-4c2e-8a35-f0c1b954532f None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:12.772645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b3106-d7a8-4c2e-8a35-f0c1b954532f None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:12.777590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b189557-3fd7-436a-9b47-9298b341deac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:12.778238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b189557-3fd7-436a-9b47-9298b341deac admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:12.778521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b189557-3fd7-436a-9b47-9298b341deac admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:12.778797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b189557-3fd7-436a-9b47-9298b341deac admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:12.779925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b189557-3fd7-436a-9b47-9298b341deac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:00:12.780370 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b189557-3fd7-436a-9b47-9298b341deac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:12.781981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b189557-3fd7-436a-9b47-9298b341deac admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:12.793833 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1322/2611] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 09:00:12.798709 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92500887-82e1-42c3-a6e6-45fef424e079 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:12.808261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92500887-82e1-42c3-a6e6-45fef424e079 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:12.813576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eaf1f-5946-4576-8ad8-af23e410cf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:12.814226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eaf1f-5946-4576-8ad8-af23e410cf68 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:12.814511 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eaf1f-5946-4576-8ad8-af23e410cf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:12.814786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eaf1f-5946-4576-8ad8-af23e410cf68 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:12.815515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eaf1f-5946-4576-8ad8-af23e410cf68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:12.817411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eaf1f-5946-4576-8ad8-af23e410cf68 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:12.938826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1290/2612] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:12 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:12.942951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b189557-3fd7-436a-9b47-9298b341deac admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:12.953501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b189557-3fd7-436a-9b47-9298b341deac admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:12.978554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:13.010550 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e602a3-c379-4533-b15b-de211034c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:13.011602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e602a3-c379-4533-b15b-de211034c2cc admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:13.011941 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e602a3-c379-4533-b15b-de211034c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:13.012225 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e602a3-c379-4533-b15b-de211034c2cc admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:13.012910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e602a3-c379-4533-b15b-de211034c2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:13.015001 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e602a3-c379-4533-b15b-de211034c2cc admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:13.138212 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1323/2613] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:12 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:13.142068 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eaf1f-5946-4576-8ad8-af23e410cf68 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:13.152786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eaf1f-5946-4576-8ad8-af23e410cf68 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:13.158657 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f29b4-b30f-41eb-86eb-d161d21dffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:13.159321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f29b4-b30f-41eb-86eb-d161d21dffbd admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:13.159637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f29b4-b30f-41eb-86eb-d161d21dffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:13.159920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f29b4-b30f-41eb-86eb-d161d21dffbd admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:13.160646 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f29b4-b30f-41eb-86eb-d161d21dffbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:13.162261 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f29b4-b30f-41eb-86eb-d161d21dffbd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:13.174137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1291/2614] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:13.177945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e602a3-c379-4533-b15b-de211034c2cc admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:13.189048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e602a3-c379-4533-b15b-de211034c2cc admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:13.193590 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859149e-2f25-49e1-aa2b-aa03882221a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:13.194253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859149e-2f25-49e1-aa2b-aa03882221a0 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:13.194537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859149e-2f25-49e1-aa2b-aa03882221a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:13.194812 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859149e-2f25-49e1-aa2b-aa03882221a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:13.195569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859149e-2f25-49e1-aa2b-aa03882221a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:13.197204 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859149e-2f25-49e1-aa2b-aa03882221a0 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:13.207583 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1324/2615] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:13.211710 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f29b4-b30f-41eb-86eb-d161d21dffbd admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:13.223599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f29b4-b30f-41eb-86eb-d161d21dffbd admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:13.228438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aa032-cadc-4097-9c74-f8ec074e4ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:13.229353 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa032-cadc-4097-9c74-f8ec074e4ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:13.229637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa032-cadc-4097-9c74-f8ec074e4ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:13.229915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa032-cadc-4097-9c74-f8ec074e4ddd admin admin] PATH_INFO: `/v3/projects/58b08acbca2c4985b762d0d74f6a8f36/users/58073d23bcbe4b1b990860615a26df90/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:13.245675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa032-cadc-4097-9c74-f8ec074e4ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b08acbca2c4985b762d0d74f6a8f36, user_id=58073d23bcbe4b1b990860615a26df90, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:13.248375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa032-cadc-4097-9c74-f8ec074e4ddd admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:13.326373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1292/2616] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:13 2022] PUT /identity/v3/projects/58b08acbca2c4985b762d0d74f6a8f36/users/58073d23bcbe4b1b990860615a26df90/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:13.337363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98790dee-9ada-4d62-b23b-cf238dda3cd2 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:13.337652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98790dee-9ada-4d62-b23b-cf238dda3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:13.337932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98790dee-9ada-4d62-b23b-cf238dda3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:13.365640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-98790dee-9ada-4d62-b23b-cf238dda3cd2 None None] MFA Rules not processed for user `58073d23bcbe4b1b990860615a26df90`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:13.366852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-98790dee-9ada-4d62-b23b-cf238dda3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:13.431499 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1325/2617] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:13.435993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aa032-cadc-4097-9c74-f8ec074e4ddd admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:13.505437 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aa032-cadc-4097-9c74-f8ec074e4ddd admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:13.511561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24e10a-f3ee-4b80-98b7-9354c5f57650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:13.512228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24e10a-f3ee-4b80-98b7-9354c5f57650 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:13.512510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24e10a-f3ee-4b80-98b7-9354c5f57650 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:13.512786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24e10a-f3ee-4b80-98b7-9354c5f57650 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:13.513489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24e10a-f3ee-4b80-98b7-9354c5f57650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:13.516357 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24e10a-f3ee-4b80-98b7-9354c5f57650 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:13.635370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1293/2618] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:13 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:13.640292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98790dee-9ada-4d62-b23b-cf238dda3cd2 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:13.651459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98790dee-9ada-4d62-b23b-cf238dda3cd2 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:13.712541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba79d16-ac07-45de-9ee4-f89e082d5f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:13.713118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79d16-ac07-45de-9ee4-f89e082d5f47 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:13.713401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79d16-ac07-45de-9ee4-f89e082d5f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:13.713677 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba79d16-ac07-45de-9ee4-f89e082d5f47 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:13.714369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba79d16-ac07-45de-9ee4-f89e082d5f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:13.716356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba79d16-ac07-45de-9ee4-f89e082d5f47 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:13.801441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1326/2619] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:13 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:13.805903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24e10a-f3ee-4b80-98b7-9354c5f57650 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:13.817813 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24e10a-f3ee-4b80-98b7-9354c5f57650 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:13.823046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46bcdd-dcba-4f94-976b-d733cc890f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:13.823787 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46bcdd-dcba-4f94-976b-d733cc890f40 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:13.824090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46bcdd-dcba-4f94-976b-d733cc890f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:13.824371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46bcdd-dcba-4f94-976b-d733cc890f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:13.825113 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46bcdd-dcba-4f94-976b-d733cc890f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:13.826817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46bcdd-dcba-4f94-976b-d733cc890f40 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:13.839534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1294/2620] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:13.844117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba79d16-ac07-45de-9ee4-f89e082d5f47 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:13.855083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba79d16-ac07-45de-9ee4-f89e082d5f47 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:13.860167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc7ed-ba2e-41be-8e9d-507debed8fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:13.861077 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc7ed-ba2e-41be-8e9d-507debed8fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:13.861359 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc7ed-ba2e-41be-8e9d-507debed8fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:13.861637 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc7ed-ba2e-41be-8e9d-507debed8fa9 admin admin] PATH_INFO: `/v3/projects/27fb107383ea4488abd26793b967026e/users/b57b5fc135d2435794c9a9c390a173c7/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:13.878710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc7ed-ba2e-41be-8e9d-507debed8fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fb107383ea4488abd26793b967026e, user_id=b57b5fc135d2435794c9a9c390a173c7, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:13.881401 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc7ed-ba2e-41be-8e9d-507debed8fa9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:13.956361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1327/2621] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:13 2022] PUT /identity/v3/projects/27fb107383ea4488abd26793b967026e/users/b57b5fc135d2435794c9a9c390a173c7/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:13.960417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46bcdd-dcba-4f94-976b-d733cc890f40 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:13.970825 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46bcdd-dcba-4f94-976b-d733cc890f40 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:13.990727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:14.027701 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6bd79-038e-42a3-a0b2-b48d4e8f0d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:14.028377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6bd79-038e-42a3-a0b2-b48d4e8f0d1d admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:14.028741 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6bd79-038e-42a3-a0b2-b48d4e8f0d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:14.028937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6bd79-038e-42a3-a0b2-b48d4e8f0d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:14.029666 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6bd79-038e-42a3-a0b2-b48d4e8f0d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:14.031315 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6bd79-038e-42a3-a0b2-b48d4e8f0d1d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:14.041404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1295/2622] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:14.045664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc7ed-ba2e-41be-8e9d-507debed8fa9 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:14.051610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:14.057538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc7ed-ba2e-41be-8e9d-507debed8fa9 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:14.073519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12091dce-09e3-4621-bc3f-48629681a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:14.073519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12091dce-09e3-4621-bc3f-48629681a3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:14.073519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12091dce-09e3-4621-bc3f-48629681a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:14.073519 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12091dce-09e3-4621-bc3f-48629681a3f9 admin admin] PATH_INFO: `/v3/projects/27fb107383ea4488abd26793b967026e/users/b57b5fc135d2435794c9a9c390a173c7/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:14.074031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12091dce-09e3-4621-bc3f-48629681a3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fb107383ea4488abd26793b967026e, user_id=b57b5fc135d2435794c9a9c390a173c7, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:14.074031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12091dce-09e3-4621-bc3f-48629681a3f9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:14.081065 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1328/2623] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:14 2022] PUT /identity/v3/projects/27fb107383ea4488abd26793b967026e/users/b57b5fc135d2435794c9a9c390a173c7/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:14.091595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221726-3774-4338-9c3a-e103bb3ee727 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:14.092163 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221726-3774-4338-9c3a-e103bb3ee727 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:14.092722 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221726-3774-4338-9c3a-e103bb3ee727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:14.120137 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-13221726-3774-4338-9c3a-e103bb3ee727 None None] MFA Rules not processed for user `b57b5fc135d2435794c9a9c390a173c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:14.121362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-13221726-3774-4338-9c3a-e103bb3ee727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:14.193025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1296/2624] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 09:00:14.205292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12091dce-09e3-4621-bc3f-48629681a3f9 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:14.207026 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-12091dce-09e3-4621-bc3f-48629681a3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:14.265086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12091dce-09e3-4621-bc3f-48629681a3f9 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:14.268867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36b7a-f515-4b2d-8828-a38b88caab8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:14.269512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36b7a-f515-4b2d-8828-a38b88caab8b service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:14.269836 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36b7a-f515-4b2d-8828-a38b88caab8b service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:14.270116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36b7a-f515-4b2d-8828-a38b88caab8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:14.279109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af36b7a-f515-4b2d-8828-a38b88caab8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:14.280578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af36b7a-f515-4b2d-8828-a38b88caab8b service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:14.289913 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1329/2625] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:15.214480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13221726-3774-4338-9c3a-e103bb3ee727 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:15.278373 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13221726-3774-4338-9c3a-e103bb3ee727 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:15.283056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:15.283967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:15.284242 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:15.284518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] PATH_INFO: `/v3/users/58073d23bcbe4b1b990860615a26df90` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:15.286011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58073d23bcbe4b1b990860615a26df90)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:15.287952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:15.442655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58073d23bcbe4b1b990860615a26df90'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:15.444069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:15.451077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58073d23bcbe4b1b990860615a26df90'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:15.604591 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58073d23bcbe4b1b990860615a26df90'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:15.605148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58073d23bcbe4b1b990860615a26df90'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:15.605752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58073d23bcbe4b1b990860615a26df90'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:15.625102 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1297/2626] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:15 2022] DELETE /identity/v3/users/58073d23bcbe4b1b990860615a26df90 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 09:00:15.631133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d866-d66e-4e39-aa66-8d889671137e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:15.631706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d866-d66e-4e39-aa66-8d889671137e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:15.631706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d866-d66e-4e39-aa66-8d889671137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:15.649384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-b6f1d866-d66e-4e39-aa66-8d889671137e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:15.650610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b6f1d866-d66e-4e39-aa66-8d889671137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:15.711174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1330/2627] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:15.721510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:15.722932 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:15.781234 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51048a-7861-4baf-8e5e-b7fec48f20c9 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:15.784847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575dff8-7380-4abf-a09c-bdd7c30751bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:15.785497 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575dff8-7380-4abf-a09c-bdd7c30751bf service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:15.785780 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575dff8-7380-4abf-a09c-bdd7c30751bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:15.786058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575dff8-7380-4abf-a09c-bdd7c30751bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:15.795147 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575dff8-7380-4abf-a09c-bdd7c30751bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:15.797395 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575dff8-7380-4abf-a09c-bdd7c30751bf service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:15.807316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1298/2628] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:16.339854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1d866-d66e-4e39-aa66-8d889671137e None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:16.341437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b6f1d866-d66e-4e39-aa66-8d889671137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:16.358149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1d866-d66e-4e39-aa66-8d889671137e None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:16.363693 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:16.365210 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:16.365364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:16.365803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] PATH_INFO: `/v3/projects/58b08acbca2c4985b762d0d74f6a8f36` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:16.367149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b08acbca2c4985b762d0d74f6a8f36)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:16.369112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:16.538409 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b08acbca2c4985b762d0d74f6a8f36', 'request_id': 'req-60431d35-e954-402b-8362-472c3e1bdeab'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:16.544908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b08acbca2c4985b762d0d74f6a8f36', 'request_id': 'req-60431d35-e954-402b-8362-472c3e1bdeab'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:16.551245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b08acbca2c4985b762d0d74f6a8f36', 'request_id': 'req-60431d35-e954-402b-8362-472c3e1bdeab'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:16.657287 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] The token cache is being invalidate because project 58b08acbca2c4985b762d0d74f6a8f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:16.658016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:16.658124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:16.659701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1331/2629] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:16 2022] DELETE /identity/v3/projects/58b08acbca2c4985b762d0d74f6a8f36 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:16.663733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575dff8-7380-4abf-a09c-bdd7c30751bf service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:16.674117 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575dff8-7380-4abf-a09c-bdd7c30751bf service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:16.730121 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:16.730990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:16.731274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:16.731580 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] PATH_INFO: `/v3/users/b57b5fc135d2435794c9a9c390a173c7` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:16.733332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57b5fc135d2435794c9a9c390a173c7)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:16.735549 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:16.939727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57b5fc135d2435794c9a9c390a173c7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:16.946631 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57b5fc135d2435794c9a9c390a173c7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:17.063014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57b5fc135d2435794c9a9c390a173c7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:17.063734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57b5fc135d2435794c9a9c390a173c7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:17.064416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3f906575-f770-43ee-96ff-7d5778015d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57b5fc135d2435794c9a9c390a173c7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:17.070509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:17.082961 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1299/2630] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:16 2022] DELETE /identity/v3/users/b57b5fc135d2435794c9a9c390a173c7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:17.556532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:17.558103 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:17.573367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60431d35-e954-402b-8362-472c3e1bdeab admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:17.587336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:17.632251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:17.633112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:17.633391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:17.633663 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] PATH_INFO: `/v3/projects/27fb107383ea4488abd26793b967026e` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:17.634822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27fb107383ea4488abd26793b967026e)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:17.636745 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:17.767679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27fb107383ea4488abd26793b967026e', 'request_id': 'req-eff238c9-7a6d-42fa-9775-323677ac2b99'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:17.773904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27fb107383ea4488abd26793b967026e', 'request_id': 'req-eff238c9-7a6d-42fa-9775-323677ac2b99'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:17.779580 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27fb107383ea4488abd26793b967026e', 'request_id': 'req-eff238c9-7a6d-42fa-9775-323677ac2b99'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:17.851581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] The token cache is being invalidate because project 27fb107383ea4488abd26793b967026e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:17.851802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:17.852405 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-eff238c9-7a6d-42fa-9775-323677ac2b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:17.853969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1332/2631] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:17 2022] DELETE /identity/v3/projects/27fb107383ea4488abd26793b967026e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:17.858810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c91e-1061-412b-bdcb-9cdcbb35763a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:17.859299 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c91e-1061-412b-bdcb-9cdcbb35763a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:17.859460 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c91e-1061-412b-bdcb-9cdcbb35763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:17.878000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9f49c91e-1061-412b-bdcb-9cdcbb35763a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:17.879247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9f49c91e-1061-412b-bdcb-9cdcbb35763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:17.939561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1300/2632] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:17.948400 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48595-09b6-42ed-a65c-ab36b4c5470d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:17.948689 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48595-09b6-42ed-a65c-ab36b4c5470d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:17.948970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48595-09b6-42ed-a65c-ab36b4c5470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:17.968510 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3ef48595-09b6-42ed-a65c-ab36b4c5470d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:17.969726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3ef48595-09b6-42ed-a65c-ab36b4c5470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:17.977700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1333/2633] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:17.982096 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c91e-1061-412b-bdcb-9cdcbb35763a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:17.992368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c91e-1061-412b-bdcb-9cdcbb35763a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:17.996985 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab0208-f0f7-4b8f-a226-949035310c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:17.997638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab0208-f0f7-4b8f-a226-949035310c51 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:17.997922 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab0208-f0f7-4b8f-a226-949035310c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:17.998217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab0208-f0f7-4b8f-a226-949035310c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:17.999558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab0208-f0f7-4b8f-a226-949035310c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:00:17.999870 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab0208-f0f7-4b8f-a226-949035310c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:18.001461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab0208-f0f7-4b8f-a226-949035310c51 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:18.013027 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1301/2634] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 09:00:18.017655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef48595-09b6-42ed-a65c-ab36b4c5470d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:18.026951 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef48595-09b6-42ed-a65c-ab36b4c5470d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:18.031789 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aca0a-6c32-4941-99cd-399b5c28fcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:18.032441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aca0a-6c32-4941-99cd-399b5c28fcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:18.032726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aca0a-6c32-4941-99cd-399b5c28fcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:18.033005 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aca0a-6c32-4941-99cd-399b5c28fcb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:18.033686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aca0a-6c32-4941-99cd-399b5c28fcb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:18.035622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aca0a-6c32-4941-99cd-399b5c28fcb6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:18.156552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1334/2635] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:18 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:18.160646 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab0208-f0f7-4b8f-a226-949035310c51 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:18.171187 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab0208-f0f7-4b8f-a226-949035310c51 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:18.228054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c4ad5-f8e6-47e5-ba31-8b6315994ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:18.228716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c4ad5-f8e6-47e5-ba31-8b6315994ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:18.228998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c4ad5-f8e6-47e5-ba31-8b6315994ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:18.229274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c4ad5-f8e6-47e5-ba31-8b6315994ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:18.229966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c4ad5-f8e6-47e5-ba31-8b6315994ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:18.231908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c4ad5-f8e6-47e5-ba31-8b6315994ad3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:18.344401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1302/2636] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:18 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:18.348526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aca0a-6c32-4941-99cd-399b5c28fcb6 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:18.360118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aca0a-6c32-4941-99cd-399b5c28fcb6 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:18.364801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ced2-fef8-4b66-8fd4-2f2bac1619db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:18.365460 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ced2-fef8-4b66-8fd4-2f2bac1619db admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:18.365743 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ced2-fef8-4b66-8fd4-2f2bac1619db admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:18.366020 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ced2-fef8-4b66-8fd4-2f2bac1619db admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:18.366741 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21ced2-fef8-4b66-8fd4-2f2bac1619db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:18.368356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21ced2-fef8-4b66-8fd4-2f2bac1619db admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:18.378942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1335/2637] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:18.382914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c4ad5-f8e6-47e5-ba31-8b6315994ad3 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:18.393401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c4ad5-f8e6-47e5-ba31-8b6315994ad3 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:18.398213 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36801ded-f053-4166-9c3a-1611ae451944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:18.398876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36801ded-f053-4166-9c3a-1611ae451944 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:18.399158 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36801ded-f053-4166-9c3a-1611ae451944 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:18.399471 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36801ded-f053-4166-9c3a-1611ae451944 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:18.400189 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36801ded-f053-4166-9c3a-1611ae451944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:18.401820 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36801ded-f053-4166-9c3a-1611ae451944 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:18.413933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1303/2638] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:18.418319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ced2-fef8-4b66-8fd4-2f2bac1619db admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:18.429733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ced2-fef8-4b66-8fd4-2f2bac1619db admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:18.434847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6521d-b929-4406-8415-2de389b3338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:18.435859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6521d-b929-4406-8415-2de389b3338b admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:18.436276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6521d-b929-4406-8415-2de389b3338b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:18.436553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6521d-b929-4406-8415-2de389b3338b admin admin] PATH_INFO: `/v3/projects/a945b653504b4374b39ec78844ab55d7/users/bb16c0f0c6934b28b2f3f6e3ca91407a/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:18.454445 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6521d-b929-4406-8415-2de389b3338b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a945b653504b4374b39ec78844ab55d7, user_id=bb16c0f0c6934b28b2f3f6e3ca91407a, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:18.457252 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6521d-b929-4406-8415-2de389b3338b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:18.531690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1336/2639] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:18 2022] PUT /identity/v3/projects/a945b653504b4374b39ec78844ab55d7/users/bb16c0f0c6934b28b2f3f6e3ca91407a/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:18.542112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d226266-f612-4d79-92c2-03553a82c99d None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:18.542401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d226266-f612-4d79-92c2-03553a82c99d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:18.542686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d226266-f612-4d79-92c2-03553a82c99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:18.571024 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-8d226266-f612-4d79-92c2-03553a82c99d None None] MFA Rules not processed for user `bb16c0f0c6934b28b2f3f6e3ca91407a`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:18.572316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8d226266-f612-4d79-92c2-03553a82c99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:18.614050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:18.636661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1304/2640] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:18.641209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6521d-b929-4406-8415-2de389b3338b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:18.691216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:18.711380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6521d-b929-4406-8415-2de389b3338b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:18.716361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5c416-b4f2-46b0-8b15-dd5586c43105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:18.717043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5c416-b4f2-46b0-8b15-dd5586c43105 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:18.717497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5c416-b4f2-46b0-8b15-dd5586c43105 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:18.717867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5c416-b4f2-46b0-8b15-dd5586c43105 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:18.718573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5c416-b4f2-46b0-8b15-dd5586c43105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:18.720527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5c416-b4f2-46b0-8b15-dd5586c43105 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:18.835216 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1337/2641] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:18 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 09:00:18.839022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d226266-f612-4d79-92c2-03553a82c99d None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:18.850124 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d226266-f612-4d79-92c2-03553a82c99d None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:18.910868 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8191015-c5b4-4332-95da-f802f5b1f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:18.911715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8191015-c5b4-4332-95da-f802f5b1f92d admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:18.912083 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8191015-c5b4-4332-95da-f802f5b1f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:18.912412 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8191015-c5b4-4332-95da-f802f5b1f92d admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:18.913272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8191015-c5b4-4332-95da-f802f5b1f92d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:18.915230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8191015-c5b4-4332-95da-f802f5b1f92d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:19.012655 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1305/2642] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:18 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:19.016710 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5c416-b4f2-46b0-8b15-dd5586c43105 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:19.027471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5c416-b4f2-46b0-8b15-dd5586c43105 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:19.032327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984a84e-f755-4241-8cd5-9483bb54cf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:19.033043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984a84e-f755-4241-8cd5-9483bb54cf36 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:19.033327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984a84e-f755-4241-8cd5-9483bb54cf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:19.033613 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984a84e-f755-4241-8cd5-9483bb54cf36 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:19.034350 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984a84e-f755-4241-8cd5-9483bb54cf36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:19.036013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984a84e-f755-4241-8cd5-9483bb54cf36 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:19.047973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1338/2643] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:19.052195 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8191015-c5b4-4332-95da-f802f5b1f92d admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:19.063420 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8191015-c5b4-4332-95da-f802f5b1f92d admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:19.068077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58eb61-421f-4ad3-9266-8beae0e226e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:19.068968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58eb61-421f-4ad3-9266-8beae0e226e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:19.069256 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58eb61-421f-4ad3-9266-8beae0e226e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:19.069542 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58eb61-421f-4ad3-9266-8beae0e226e4 admin admin] PATH_INFO: `/v3/projects/3f7af23ae5f440ebb915598de6a5ec5b/users/c454fb937417412595b39dfa8c97da8e/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:19.084877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58eb61-421f-4ad3-9266-8beae0e226e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7af23ae5f440ebb915598de6a5ec5b, user_id=c454fb937417412595b39dfa8c97da8e, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:19.087570 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58eb61-421f-4ad3-9266-8beae0e226e4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:19.200615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1306/2644] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:19 2022] PUT /identity/v3/projects/3f7af23ae5f440ebb915598de6a5ec5b/users/c454fb937417412595b39dfa8c97da8e/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:19.204806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984a84e-f755-4241-8cd5-9483bb54cf36 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:19.215056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984a84e-f755-4241-8cd5-9483bb54cf36 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:19.273665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd247e1a-8c1a-49b9-b0f4-37b55869d809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:19.274262 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247e1a-8c1a-49b9-b0f4-37b55869d809 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:19.274549 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247e1a-8c1a-49b9-b0f4-37b55869d809 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:19.274828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247e1a-8c1a-49b9-b0f4-37b55869d809 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:19.275604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd247e1a-8c1a-49b9-b0f4-37b55869d809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:19.277257 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd247e1a-8c1a-49b9-b0f4-37b55869d809 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:19.288621 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1339/2645] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:19.292833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58eb61-421f-4ad3-9266-8beae0e226e4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:19.304162 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58eb61-421f-4ad3-9266-8beae0e226e4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:19.309087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2675-5dc2-4ccd-9af9-795998a00510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:19.309965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2675-5dc2-4ccd-9af9-795998a00510 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:19.310245 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2675-5dc2-4ccd-9af9-795998a00510 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:19.310521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2675-5dc2-4ccd-9af9-795998a00510 admin admin] PATH_INFO: `/v3/projects/3f7af23ae5f440ebb915598de6a5ec5b/users/c454fb937417412595b39dfa8c97da8e/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:19.312654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2675-5dc2-4ccd-9af9-795998a00510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7af23ae5f440ebb915598de6a5ec5b, user_id=c454fb937417412595b39dfa8c97da8e, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:19.315293 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2675-5dc2-4ccd-9af9-795998a00510 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:19.325634 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1307/2646] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:19 2022] PUT /identity/v3/projects/3f7af23ae5f440ebb915598de6a5ec5b/users/c454fb937417412595b39dfa8c97da8e/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:19.336108 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac477-c02e-45b0-b98f-6219f19b5a17 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:19.336397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac477-c02e-45b0-b98f-6219f19b5a17 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:19.336671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac477-c02e-45b0-b98f-6219f19b5a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:19.365492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-2f6ac477-c02e-45b0-b98f-6219f19b5a17 None None] MFA Rules not processed for user `c454fb937417412595b39dfa8c97da8e`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:19.366701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2f6ac477-c02e-45b0-b98f-6219f19b5a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:19.438261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1340/2647] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:19.450582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2675-5dc2-4ccd-9af9-795998a00510 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:19.453017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-84ae2675-5dc2-4ccd-9af9-795998a00510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:19.513484 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2675-5dc2-4ccd-9af9-795998a00510 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:19.517997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3481aa-62f2-4fc2-99a0-8a77651889ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:19.518683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3481aa-62f2-4fc2-99a0-8a77651889ad service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:19.518965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3481aa-62f2-4fc2-99a0-8a77651889ad service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:19.519247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3481aa-62f2-4fc2-99a0-8a77651889ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:19.528602 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3481aa-62f2-4fc2-99a0-8a77651889ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:19.530572 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3481aa-62f2-4fc2-99a0-8a77651889ad service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:19.542203 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1308/2648] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:19.649208 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac477-c02e-45b0-b98f-6219f19b5a17 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:19.650657 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-2f6ac477-c02e-45b0-b98f-6219f19b5a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:19.663321 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac477-c02e-45b0-b98f-6219f19b5a17 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:19.667153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d95e6-dd7a-4c64-832a-3b0a5d1969b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:19.667870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d95e6-dd7a-4c64-832a-3b0a5d1969b4 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:19.668170 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d95e6-dd7a-4c64-832a-3b0a5d1969b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:19.668430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d95e6-dd7a-4c64-832a-3b0a5d1969b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:19.703137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:19.728819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d95e6-dd7a-4c64-832a-3b0a5d1969b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:19.730325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d95e6-dd7a-4c64-832a-3b0a5d1969b4 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:19.739539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1341/2649] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:24.598066 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3481aa-62f2-4fc2-99a0-8a77651889ad service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:24.641584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:24.664115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3481aa-62f2-4fc2-99a0-8a77651889ad service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:24.668814 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:24.669720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:24.670007 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:24.670283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] PATH_INFO: `/v3/users/bb16c0f0c6934b28b2f3f6e3ca91407a` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:24.672469 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb16c0f0c6934b28b2f3f6e3ca91407a)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:24.674398 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:24.843908 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb16c0f0c6934b28b2f3f6e3ca91407a'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:24.850882 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb16c0f0c6934b28b2f3f6e3ca91407a'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:24.918887 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb16c0f0c6934b28b2f3f6e3ca91407a'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:24.919558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb16c0f0c6934b28b2f3f6e3ca91407a'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:24.920198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb16c0f0c6934b28b2f3f6e3ca91407a'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:24.938499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1309/2650] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:24 2022] DELETE /identity/v3/users/bb16c0f0c6934b28b2f3f6e3ca91407a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:24.943131 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19b22e-caa9-4fb8-87e0-d299498370ce None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:24.943653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19b22e-caa9-4fb8-87e0-d299498370ce None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:24.943756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19b22e-caa9-4fb8-87e0-d299498370ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:24.961973 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1d19b22e-caa9-4fb8-87e0-d299498370ce None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:24.963331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1d19b22e-caa9-4fb8-87e0-d299498370ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:25.024038 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1342/2651] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:25.034455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:25.035924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:25.094332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b5678-28bd-4e10-9dd2-d7e7d443f13c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:25.097938 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e327a-615b-46dd-8cd8-3becf2f4d9a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:25.098586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e327a-615b-46dd-8cd8-3becf2f4d9a2 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:25.098869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e327a-615b-46dd-8cd8-3becf2f4d9a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:25.099148 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e327a-615b-46dd-8cd8-3becf2f4d9a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:25.108683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e327a-615b-46dd-8cd8-3becf2f4d9a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:25.110119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e327a-615b-46dd-8cd8-3becf2f4d9a2 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:25.119745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1310/2652] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:25.568476 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19b22e-caa9-4fb8-87e0-d299498370ce None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:25.569939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1d19b22e-caa9-4fb8-87e0-d299498370ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:25.583616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19b22e-caa9-4fb8-87e0-d299498370ce None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:25.588203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:25.589073 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:25.589354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:25.589630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] PATH_INFO: `/v3/projects/a945b653504b4374b39ec78844ab55d7` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:25.590938 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a945b653504b4374b39ec78844ab55d7)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:25.593246 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:25.692185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a945b653504b4374b39ec78844ab55d7', 'request_id': 'req-c5639084-f30a-4cd2-a093-3343f0d72e00'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:25.698188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a945b653504b4374b39ec78844ab55d7', 'request_id': 'req-c5639084-f30a-4cd2-a093-3343f0d72e00'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:25.703932 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a945b653504b4374b39ec78844ab55d7', 'request_id': 'req-c5639084-f30a-4cd2-a093-3343f0d72e00'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:25.777177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] The token cache is being invalidate because project a945b653504b4374b39ec78844ab55d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:25.777483 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:25.778137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:25.779875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1343/2653] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:25 2022] DELETE /identity/v3/projects/a945b653504b4374b39ec78844ab55d7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:25.784029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e327a-615b-46dd-8cd8-3becf2f4d9a2 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:25.794472 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e327a-615b-46dd-8cd8-3becf2f4d9a2 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:25.852291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:25.853168 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:25.853446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:25.853723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] PATH_INFO: `/v3/users/c454fb937417412595b39dfa8c97da8e` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:25.854949 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c454fb937417412595b39dfa8c97da8e)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:25.856890 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:25.859465 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:26.053508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c454fb937417412595b39dfa8c97da8e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:26.060811 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c454fb937417412595b39dfa8c97da8e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:26.143532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c454fb937417412595b39dfa8c97da8e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:26.144191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c454fb937417412595b39dfa8c97da8e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:26.144824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-903ccb02-631b-4dda-b89e-4146ee2622e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c454fb937417412595b39dfa8c97da8e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:26.164877 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1311/2654] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:25 2022] DELETE /identity/v3/users/c454fb937417412595b39dfa8c97da8e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:26.594053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:26.595554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:26.609303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5639084-f30a-4cd2-a093-3343f0d72e00 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:26.665931 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:26.666790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:26.667070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:26.667344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] PATH_INFO: `/v3/projects/3f7af23ae5f440ebb915598de6a5ec5b` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:26.668539 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7af23ae5f440ebb915598de6a5ec5b)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:26.670520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:26.672019 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:26.785686 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7af23ae5f440ebb915598de6a5ec5b', 'request_id': 'req-3dc7e19c-e0bb-41b1-b008-b77c601125ea'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:26.792571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7af23ae5f440ebb915598de6a5ec5b', 'request_id': 'req-3dc7e19c-e0bb-41b1-b008-b77c601125ea'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:26.799761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7af23ae5f440ebb915598de6a5ec5b', 'request_id': 'req-3dc7e19c-e0bb-41b1-b008-b77c601125ea'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:26.884172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] The token cache is being invalidate because project 3f7af23ae5f440ebb915598de6a5ec5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:26.884448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:26.885029 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-3dc7e19c-e0bb-41b1-b008-b77c601125ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:26.886566 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1344/2655] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:26 2022] DELETE /identity/v3/projects/3f7af23ae5f440ebb915598de6a5ec5b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:26.892518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925de66-8c63-408f-8ea3-bafb2c92de89 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:26.893069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925de66-8c63-408f-8ea3-bafb2c92de89 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:26.893185 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925de66-8c63-408f-8ea3-bafb2c92de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:26.911377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-9925de66-8c63-408f-8ea3-bafb2c92de89 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:26.912605 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9925de66-8c63-408f-8ea3-bafb2c92de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:26.976480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1312/2656] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:26.985829 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecf60b-6ae4-4ed3-9282-f5e9d5fd5330 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:26.986119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecf60b-6ae4-4ed3-9282-f5e9d5fd5330 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:26.986404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecf60b-6ae4-4ed3-9282-f5e9d5fd5330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:27.005600 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-d4ecf60b-6ae4-4ed3-9282-f5e9d5fd5330 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:27.006814 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-d4ecf60b-6ae4-4ed3-9282-f5e9d5fd5330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:27.015481 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1345/2657] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:27.019769 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925de66-8c63-408f-8ea3-bafb2c92de89 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:27.029691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925de66-8c63-408f-8ea3-bafb2c92de89 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:27.034634 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aa727-1a7d-4b13-b73e-29181a7b3c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:27.035292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aa727-1a7d-4b13-b73e-29181a7b3c81 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:27.035614 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aa727-1a7d-4b13-b73e-29181a7b3c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:27.035885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aa727-1a7d-4b13-b73e-29181a7b3c81 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:27.036599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92aa727-1a7d-4b13-b73e-29181a7b3c81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:00:27.036904 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92aa727-1a7d-4b13-b73e-29181a7b3c81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:27.038488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92aa727-1a7d-4b13-b73e-29181a7b3c81 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:27.050854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1313/2658] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 09:00:27.055179 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecf60b-6ae4-4ed3-9282-f5e9d5fd5330 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:27.065589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecf60b-6ae4-4ed3-9282-f5e9d5fd5330 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:27.070312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c919cc7-a60b-422c-999b-bb5caf85bb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:27.070977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c919cc7-a60b-422c-999b-bb5caf85bb67 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:27.071260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c919cc7-a60b-422c-999b-bb5caf85bb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:27.071570 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c919cc7-a60b-422c-999b-bb5caf85bb67 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:27.072278 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c919cc7-a60b-422c-999b-bb5caf85bb67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:27.074172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c919cc7-a60b-422c-999b-bb5caf85bb67 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:27.160797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1346/2659] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:27 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:27.164946 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aa727-1a7d-4b13-b73e-29181a7b3c81 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:27.175795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aa727-1a7d-4b13-b73e-29181a7b3c81 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:27.237556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283347-0a44-435e-9257-969f86bc5395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:27.238229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283347-0a44-435e-9257-969f86bc5395 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:27.238514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283347-0a44-435e-9257-969f86bc5395 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:27.238791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283347-0a44-435e-9257-969f86bc5395 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:27.239534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283347-0a44-435e-9257-969f86bc5395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:27.241425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283347-0a44-435e-9257-969f86bc5395 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:27.251891 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:27.353355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1314/2660] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:27 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:27.357432 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c919cc7-a60b-422c-999b-bb5caf85bb67 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:27.368442 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c919cc7-a60b-422c-999b-bb5caf85bb67 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:27.373046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb30b7-2f68-46b8-9b45-d7fb0f88dc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:27.373772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb30b7-2f68-46b8-9b45-d7fb0f88dc84 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:27.374058 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb30b7-2f68-46b8-9b45-d7fb0f88dc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:27.374338 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb30b7-2f68-46b8-9b45-d7fb0f88dc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:27.375125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb30b7-2f68-46b8-9b45-d7fb0f88dc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:27.376751 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb30b7-2f68-46b8-9b45-d7fb0f88dc84 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:27.387196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1347/2661] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:27.391450 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283347-0a44-435e-9257-969f86bc5395 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:27.401792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283347-0a44-435e-9257-969f86bc5395 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:27.407134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d319a0e-c9a8-44df-b130-82eb60e7ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:27.407822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d319a0e-c9a8-44df-b130-82eb60e7ef44 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:27.408105 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d319a0e-c9a8-44df-b130-82eb60e7ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:27.408380 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d319a0e-c9a8-44df-b130-82eb60e7ef44 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:27.409233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d319a0e-c9a8-44df-b130-82eb60e7ef44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:27.414365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d319a0e-c9a8-44df-b130-82eb60e7ef44 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:27.422470 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1315/2662] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:27.426788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb30b7-2f68-46b8-9b45-d7fb0f88dc84 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:27.437251 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb30b7-2f68-46b8-9b45-d7fb0f88dc84 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:27.441826 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25931-06ca-414d-9e15-af549aa5d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:27.442708 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25931-06ca-414d-9e15-af549aa5d991 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:27.442995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25931-06ca-414d-9e15-af549aa5d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:27.443272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25931-06ca-414d-9e15-af549aa5d991 admin admin] PATH_INFO: `/v3/projects/0a12adf509924ba88b4ce9838979a9a6/users/de8017f0bc114110b21b062043e62030/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:27.460956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25931-06ca-414d-9e15-af549aa5d991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a12adf509924ba88b4ce9838979a9a6, user_id=de8017f0bc114110b21b062043e62030, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:27.463687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25931-06ca-414d-9e15-af549aa5d991 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:27.555668 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1348/2663] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:27 2022] PUT /identity/v3/projects/0a12adf509924ba88b4ce9838979a9a6/users/de8017f0bc114110b21b062043e62030/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 09:00:27.566035 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c0045-8693-4d5f-82b6-e666052ecddd None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:27.566318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c0045-8693-4d5f-82b6-e666052ecddd None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:27.566595 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c0045-8693-4d5f-82b6-e666052ecddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:27.594176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-583c0045-8693-4d5f-82b6-e666052ecddd None None] MFA Rules not processed for user `de8017f0bc114110b21b062043e62030`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:27.595457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-583c0045-8693-4d5f-82b6-e666052ecddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:27.660734 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1316/2664] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:27.665279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25931-06ca-414d-9e15-af549aa5d991 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:27.728115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25931-06ca-414d-9e15-af549aa5d991 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:27.733467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ebfe-9581-4ab4-a45b-a57317eefaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:27.734135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ebfe-9581-4ab4-a45b-a57317eefaac admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:27.734413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ebfe-9581-4ab4-a45b-a57317eefaac admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:27.734687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ebfe-9581-4ab4-a45b-a57317eefaac admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:27.735414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6ebfe-9581-4ab4-a45b-a57317eefaac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:27.737307 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6ebfe-9581-4ab4-a45b-a57317eefaac admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:27.820127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1349/2665] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:27 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:27.824413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c0045-8693-4d5f-82b6-e666052ecddd None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:27.835494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c0045-8693-4d5f-82b6-e666052ecddd None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:27.894481 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76795b0a-bb2f-45ad-9ec8-ab37aad77d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:27.895174 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76795b0a-bb2f-45ad-9ec8-ab37aad77d6e admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:27.895475 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76795b0a-bb2f-45ad-9ec8-ab37aad77d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:27.895753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76795b0a-bb2f-45ad-9ec8-ab37aad77d6e admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:27.896436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76795b0a-bb2f-45ad-9ec8-ab37aad77d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:27.899188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76795b0a-bb2f-45ad-9ec8-ab37aad77d6e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:27.984720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1317/2666] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:27 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:27.988874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ebfe-9581-4ab4-a45b-a57317eefaac admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:27.999832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ebfe-9581-4ab4-a45b-a57317eefaac admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:28.004451 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc517-c6f1-4e5f-82ab-c68bcd4efe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:28.005117 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc517-c6f1-4e5f-82ab-c68bcd4efe4f admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:28.005399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc517-c6f1-4e5f-82ab-c68bcd4efe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:28.005676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc517-c6f1-4e5f-82ab-c68bcd4efe4f admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:28.006395 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bc517-c6f1-4e5f-82ab-c68bcd4efe4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:28.008041 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bc517-c6f1-4e5f-82ab-c68bcd4efe4f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:28.013440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:28.018993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1350/2667] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:28.030018 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76795b0a-bb2f-45ad-9ec8-ab37aad77d6e admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:28.040208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76795b0a-bb2f-45ad-9ec8-ab37aad77d6e admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:28.044782 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13810410-c38f-4059-bde0-28d4ababbd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:28.046263 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13810410-c38f-4059-bde0-28d4ababbd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:28.046546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13810410-c38f-4059-bde0-28d4ababbd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:28.046822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13810410-c38f-4059-bde0-28d4ababbd1e admin admin] PATH_INFO: `/v3/projects/5227344fc0784230beae54b9a4e633b3/users/0c8c126baeda4839836c12a3229514ca/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:28.063057 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13810410-c38f-4059-bde0-28d4ababbd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5227344fc0784230beae54b9a4e633b3, user_id=0c8c126baeda4839836c12a3229514ca, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:28.065749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13810410-c38f-4059-bde0-28d4ababbd1e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:28.167421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1318/2668] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:28 2022] PUT /identity/v3/projects/5227344fc0784230beae54b9a4e633b3/users/0c8c126baeda4839836c12a3229514ca/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:28.172917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc517-c6f1-4e5f-82ab-c68bcd4efe4f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:28.183954 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc517-c6f1-4e5f-82ab-c68bcd4efe4f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:28.242902 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbfa9d-866f-4c37-be57-d3fea375066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:28.243505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbfa9d-866f-4c37-be57-d3fea375066c admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:28.243790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbfa9d-866f-4c37-be57-d3fea375066c admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:28.244072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbfa9d-866f-4c37-be57-d3fea375066c admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:28.244790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbfa9d-866f-4c37-be57-d3fea375066c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:28.246381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbfa9d-866f-4c37-be57-d3fea375066c admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:28.257250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1351/2669] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 09:00:28.261569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13810410-c38f-4059-bde0-28d4ababbd1e admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:28.272493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13810410-c38f-4059-bde0-28d4ababbd1e admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:28.277091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5144c-de25-4ed2-bfad-34dd50b0efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:28.278000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5144c-de25-4ed2-bfad-34dd50b0efb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:28.278282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5144c-de25-4ed2-bfad-34dd50b0efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:28.278551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5144c-de25-4ed2-bfad-34dd50b0efb4 admin admin] PATH_INFO: `/v3/projects/5227344fc0784230beae54b9a4e633b3/users/0c8c126baeda4839836c12a3229514ca/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:28.281316 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5144c-de25-4ed2-bfad-34dd50b0efb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5227344fc0784230beae54b9a4e633b3, user_id=0c8c126baeda4839836c12a3229514ca, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:28.283974 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5144c-de25-4ed2-bfad-34dd50b0efb4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:28.294328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1319/2670] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:28 2022] PUT /identity/v3/projects/5227344fc0784230beae54b9a4e633b3/users/0c8c126baeda4839836c12a3229514ca/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:28.306645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32f73f-57d6-41cb-882d-435fcd51b747 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:28.306976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32f73f-57d6-41cb-882d-435fcd51b747 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:28.307256 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32f73f-57d6-41cb-882d-435fcd51b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:28.335691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-7a32f73f-57d6-41cb-882d-435fcd51b747 None None] MFA Rules not processed for user `0c8c126baeda4839836c12a3229514ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:28.336906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7a32f73f-57d6-41cb-882d-435fcd51b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:28.407616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1352/2671] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:28.418829 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5144c-de25-4ed2-bfad-34dd50b0efb4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:28.421305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a0a5144c-de25-4ed2-bfad-34dd50b0efb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:28.455457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:28.487243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5144c-de25-4ed2-bfad-34dd50b0efb4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:28.491298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a02edc-d403-44f8-8af2-0804abeec61a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:28.496795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a02edc-d403-44f8-8af2-0804abeec61a service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:28.496795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a02edc-d403-44f8-8af2-0804abeec61a service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:28.496795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a02edc-d403-44f8-8af2-0804abeec61a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:28.502625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a02edc-d403-44f8-8af2-0804abeec61a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:28.504209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a02edc-d403-44f8-8af2-0804abeec61a service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:28.515273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1320/2672] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:28.547440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32f73f-57d6-41cb-882d-435fcd51b747 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:28.616083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32f73f-57d6-41cb-882d-435fcd51b747 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:28.620715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:28.621611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:28.621892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:28.622168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] PATH_INFO: `/v3/users/de8017f0bc114110b21b062043e62030` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:28.623635 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8017f0bc114110b21b062043e62030)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:28.625761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:28.650516 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:28.819391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8017f0bc114110b21b062043e62030'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:28.832396 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8017f0bc114110b21b062043e62030'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:28.925837 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8017f0bc114110b21b062043e62030'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:28.933629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8017f0bc114110b21b062043e62030'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:28.934279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8017f0bc114110b21b062043e62030'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:28.941015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1353/2673] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:28 2022] DELETE /identity/v3/users/de8017f0bc114110b21b062043e62030 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:28.945993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1193-589b-4a12-8610-7f60a0330218 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:28.945993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1193-589b-4a12-8610-7f60a0330218 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:28.946540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1193-589b-4a12-8610-7f60a0330218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:28.964411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-3c2f1193-589b-4a12-8610-7f60a0330218 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:28.965628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3c2f1193-589b-4a12-8610-7f60a0330218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:29.023821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1321/2674] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:29.033781 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:29.035198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:29.093630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165b178-3974-459a-af87-fcae0b4d6f58 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:29.097134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d14c82-1aba-4bd0-b482-11855fdfd4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:29.097772 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14c82-1aba-4bd0-b482-11855fdfd4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:29.098055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14c82-1aba-4bd0-b482-11855fdfd4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:29.098331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d14c82-1aba-4bd0-b482-11855fdfd4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:29.107233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d14c82-1aba-4bd0-b482-11855fdfd4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:29.108860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d14c82-1aba-4bd0-b482-11855fdfd4f2 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:29.118227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1354/2675] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 09:00:29.574939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f1193-589b-4a12-8610-7f60a0330218 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:29.574939 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3c2f1193-589b-4a12-8610-7f60a0330218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:29.590002 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f1193-589b-4a12-8610-7f60a0330218 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:29.595500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:29.596438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:29.596718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:29.597022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] PATH_INFO: `/v3/projects/0a12adf509924ba88b4ce9838979a9a6` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:29.598207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a12adf509924ba88b4ce9838979a9a6)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:29.604022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:29.721541 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a12adf509924ba88b4ce9838979a9a6', 'request_id': 'req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:29.728065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a12adf509924ba88b4ce9838979a9a6', 'request_id': 'req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:29.734727 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a12adf509924ba88b4ce9838979a9a6', 'request_id': 'req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:29.821076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] The token cache is being invalidate because project 0a12adf509924ba88b4ce9838979a9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:29.821363 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:29.822091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:29.823731 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1322/2676] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:29 2022] DELETE /identity/v3/projects/0a12adf509924ba88b4ce9838979a9a6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:29.827750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d14c82-1aba-4bd0-b482-11855fdfd4f2 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:29.837628 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d14c82-1aba-4bd0-b482-11855fdfd4f2 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:29.894006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:29.894886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:29.895173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:29.895493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] PATH_INFO: `/v3/users/0c8c126baeda4839836c12a3229514ca` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:29.896704 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8c126baeda4839836c12a3229514ca)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:29.898662 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:30.064632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:30.065958 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8c126baeda4839836c12a3229514ca'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:30.078910 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8c126baeda4839836c12a3229514ca'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:30.152999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8c126baeda4839836c12a3229514ca'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:30.161926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8c126baeda4839836c12a3229514ca'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:30.162659 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b0789ec6-7e63-4e69-a516-72b0a7cfe81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8c126baeda4839836c12a3229514ca'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:30.168791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1355/2677] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:29 2022] DELETE /identity/v3/users/0c8c126baeda4839836c12a3229514ca => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:30.585396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:30.589989 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:30.604648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cf10f-c51d-439d-99f9-1b9ffbbfa9a2 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:30.658476 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:30.668090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:30.670341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:30.670341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:30.670341 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] PATH_INFO: `/v3/projects/5227344fc0784230beae54b9a4e633b3` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:30.670960 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5227344fc0784230beae54b9a4e633b3)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:30.673130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:30.772224 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5227344fc0784230beae54b9a4e633b3', 'request_id': 'req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:30.777857 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5227344fc0784230beae54b9a4e633b3', 'request_id': 'req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:30.783833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5227344fc0784230beae54b9a4e633b3', 'request_id': 'req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:30.862671 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] The token cache is being invalidate because project 5227344fc0784230beae54b9a4e633b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:30.862919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:30.863569 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1a49b5bc-cd1c-404a-8bc9-750430b3cfd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:30.865078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1323/2678] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:30 2022] DELETE /identity/v3/projects/5227344fc0784230beae54b9a4e633b3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:30.869975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98093d63-66ee-41f2-ad6e-0fd53f49c4d9 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:30.870463 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98093d63-66ee-41f2-ad6e-0fd53f49c4d9 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:30.870578 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98093d63-66ee-41f2-ad6e-0fd53f49c4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:30.891111 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-98093d63-66ee-41f2-ad6e-0fd53f49c4d9 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:30.892371 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-98093d63-66ee-41f2-ad6e-0fd53f49c4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:30.957737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1356/2679] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:30.965663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03da9-d88f-4a9f-bcfb-6303a015026c None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:30.965984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03da9-d88f-4a9f-bcfb-6303a015026c None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:30.966269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03da9-d88f-4a9f-bcfb-6303a015026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:30.987445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2db03da9-d88f-4a9f-bcfb-6303a015026c None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:30.988705 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2db03da9-d88f-4a9f-bcfb-6303a015026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:30.996921 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1324/2680] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:31.002042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98093d63-66ee-41f2-ad6e-0fd53f49c4d9 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:31.013177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98093d63-66ee-41f2-ad6e-0fd53f49c4d9 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:31.018013 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02922079-8863-4b97-a54b-3f6c2c9954e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:31.018692 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02922079-8863-4b97-a54b-3f6c2c9954e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:31.018978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02922079-8863-4b97-a54b-3f6c2c9954e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:31.019258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02922079-8863-4b97-a54b-3f6c2c9954e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:31.020045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02922079-8863-4b97-a54b-3f6c2c9954e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:00:31.020354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02922079-8863-4b97-a54b-3f6c2c9954e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:31.021979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02922079-8863-4b97-a54b-3f6c2c9954e8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:31.034336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1357/2681] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 09:00:31.038933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db03da9-d88f-4a9f-bcfb-6303a015026c None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:31.049172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db03da9-d88f-4a9f-bcfb-6303a015026c None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:31.053900 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69be6dc-8987-4d7e-b328-72b17fdc32bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:31.054558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69be6dc-8987-4d7e-b328-72b17fdc32bf admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:31.054842 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69be6dc-8987-4d7e-b328-72b17fdc32bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:31.055122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69be6dc-8987-4d7e-b328-72b17fdc32bf admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:31.056106 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69be6dc-8987-4d7e-b328-72b17fdc32bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:31.058010 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69be6dc-8987-4d7e-b328-72b17fdc32bf admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:31.155269 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1325/2682] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:31 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:31.159492 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02922079-8863-4b97-a54b-3f6c2c9954e8 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:31.169732 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02922079-8863-4b97-a54b-3f6c2c9954e8 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:31.227523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529dc2f-f1da-4f7c-a954-8cd9e880e9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:31.228203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529dc2f-f1da-4f7c-a954-8cd9e880e9de admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:31.228490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529dc2f-f1da-4f7c-a954-8cd9e880e9de admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:31.228770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529dc2f-f1da-4f7c-a954-8cd9e880e9de admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:31.229458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529dc2f-f1da-4f7c-a954-8cd9e880e9de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:31.231413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529dc2f-f1da-4f7c-a954-8cd9e880e9de admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:31.303384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1358/2683] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:31 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:31.307841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69be6dc-8987-4d7e-b328-72b17fdc32bf admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:31.318732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69be6dc-8987-4d7e-b328-72b17fdc32bf admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:31.323455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbf796-2a18-48d8-be00-d4293af80560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:31.324139 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf796-2a18-48d8-be00-d4293af80560 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:31.326112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf796-2a18-48d8-be00-d4293af80560 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:31.326112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf796-2a18-48d8-be00-d4293af80560 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:31.326112 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbf796-2a18-48d8-be00-d4293af80560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:31.327038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbf796-2a18-48d8-be00-d4293af80560 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:31.337443 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1326/2684] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:31.341485 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529dc2f-f1da-4f7c-a954-8cd9e880e9de admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:31.352866 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529dc2f-f1da-4f7c-a954-8cd9e880e9de admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:31.357553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b2e22-4e84-41cc-bf01-88eae6679317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:31.358841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b2e22-4e84-41cc-bf01-88eae6679317 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:31.359123 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b2e22-4e84-41cc-bf01-88eae6679317 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:31.359433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b2e22-4e84-41cc-bf01-88eae6679317 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:31.360160 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b2e22-4e84-41cc-bf01-88eae6679317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:31.361742 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b2e22-4e84-41cc-bf01-88eae6679317 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:31.371669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1359/2685] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:31.375808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbf796-2a18-48d8-be00-d4293af80560 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:31.385617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbf796-2a18-48d8-be00-d4293af80560 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:31.390223 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d3b98-e3c0-481d-8cc9-cb8a39f7c95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:31.391093 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d3b98-e3c0-481d-8cc9-cb8a39f7c95b admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:31.391405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d3b98-e3c0-481d-8cc9-cb8a39f7c95b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:31.391688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d3b98-e3c0-481d-8cc9-cb8a39f7c95b admin admin] PATH_INFO: `/v3/projects/9d01af0629634f92a040e22fb019ab04/users/1accc045b6214ad4818366f2deb73d9b/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:31.406732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d3b98-e3c0-481d-8cc9-cb8a39f7c95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d01af0629634f92a040e22fb019ab04, user_id=1accc045b6214ad4818366f2deb73d9b, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:31.409402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d3b98-e3c0-481d-8cc9-cb8a39f7c95b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:31.521907 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1327/2686] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:31 2022] PUT /identity/v3/projects/9d01af0629634f92a040e22fb019ab04/users/1accc045b6214ad4818366f2deb73d9b/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:31.533085 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e7007-51a8-45c2-84df-5fbbd6492f3a None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:31.533384 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e7007-51a8-45c2-84df-5fbbd6492f3a None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:31.533790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e7007-51a8-45c2-84df-5fbbd6492f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:31.562496 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-7c3e7007-51a8-45c2-84df-5fbbd6492f3a None None] MFA Rules not processed for user `1accc045b6214ad4818366f2deb73d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:31.563884 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7c3e7007-51a8-45c2-84df-5fbbd6492f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:31.582270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:31.632888 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1360/2687] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:31.637441 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d3b98-e3c0-481d-8cc9-cb8a39f7c95b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:31.702772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d3b98-e3c0-481d-8cc9-cb8a39f7c95b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:31.707455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3cad-80f4-4a3f-95e0-de08e36125c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:31.708116 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3cad-80f4-4a3f-95e0-de08e36125c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:31.708402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3cad-80f4-4a3f-95e0-de08e36125c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:31.708687 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3cad-80f4-4a3f-95e0-de08e36125c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:31.709375 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a3cad-80f4-4a3f-95e0-de08e36125c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:31.711276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a3cad-80f4-4a3f-95e0-de08e36125c6 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:31.801725 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1328/2688] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:31 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:31.805978 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e7007-51a8-45c2-84df-5fbbd6492f3a None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:31.817472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e7007-51a8-45c2-84df-5fbbd6492f3a None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:31.872926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e10b9d-a57e-4d23-a975-884294eb9df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:31.874213 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10b9d-a57e-4d23-a975-884294eb9df9 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:31.874408 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10b9d-a57e-4d23-a975-884294eb9df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:31.874679 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10b9d-a57e-4d23-a975-884294eb9df9 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:31.875381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e10b9d-a57e-4d23-a975-884294eb9df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:31.877311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e10b9d-a57e-4d23-a975-884294eb9df9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:31.967056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1361/2689] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:31 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:31.971327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3cad-80f4-4a3f-95e0-de08e36125c6 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:31.978054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:31.981802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3cad-80f4-4a3f-95e0-de08e36125c6 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:31.986628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4346abf-9ae1-4566-9958-0410e1702e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:31.987332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4346abf-9ae1-4566-9958-0410e1702e32 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:31.987643 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4346abf-9ae1-4566-9958-0410e1702e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:31.987919 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4346abf-9ae1-4566-9958-0410e1702e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:31.988634 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4346abf-9ae1-4566-9958-0410e1702e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:31.990237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4346abf-9ae1-4566-9958-0410e1702e32 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:32.002272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1329/2690] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:32.006666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e10b9d-a57e-4d23-a975-884294eb9df9 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:32.018198 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e10b9d-a57e-4d23-a975-884294eb9df9 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:32.026438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785e768-1ae4-41fd-9a85-77240fa95532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:32.027333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785e768-1ae4-41fd-9a85-77240fa95532 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:32.027646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785e768-1ae4-41fd-9a85-77240fa95532 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:32.027924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785e768-1ae4-41fd-9a85-77240fa95532 admin admin] PATH_INFO: `/v3/projects/17b3a2337c14424eb55c7a79f27f619f/users/2ea793243635476db3920ddf9be06382/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:32.044467 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785e768-1ae4-41fd-9a85-77240fa95532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b3a2337c14424eb55c7a79f27f619f, user_id=2ea793243635476db3920ddf9be06382, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:32.047415 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785e768-1ae4-41fd-9a85-77240fa95532 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:32.115331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1362/2691] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:32 2022] PUT /identity/v3/projects/17b3a2337c14424eb55c7a79f27f619f/users/2ea793243635476db3920ddf9be06382/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:32.119324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4346abf-9ae1-4566-9958-0410e1702e32 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:32.129784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4346abf-9ae1-4566-9958-0410e1702e32 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:32.185015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed68bbd-e582-4956-949e-e6f6a5ddfddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:32.185681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed68bbd-e582-4956-949e-e6f6a5ddfddb admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:32.186526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed68bbd-e582-4956-949e-e6f6a5ddfddb admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:32.186818 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed68bbd-e582-4956-949e-e6f6a5ddfddb admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:32.187560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed68bbd-e582-4956-949e-e6f6a5ddfddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:32.189155 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed68bbd-e582-4956-949e-e6f6a5ddfddb admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:32.198826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1330/2692] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:32.203648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785e768-1ae4-41fd-9a85-77240fa95532 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:32.213739 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785e768-1ae4-41fd-9a85-77240fa95532 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:32.218513 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec8350-3285-41c3-a74c-f85a39fc1980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:32.219322 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec8350-3285-41c3-a74c-f85a39fc1980 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:32.219633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec8350-3285-41c3-a74c-f85a39fc1980 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:32.219906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec8350-3285-41c3-a74c-f85a39fc1980 admin admin] PATH_INFO: `/v3/projects/17b3a2337c14424eb55c7a79f27f619f/users/2ea793243635476db3920ddf9be06382/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:32.221842 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec8350-3285-41c3-a74c-f85a39fc1980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b3a2337c14424eb55c7a79f27f619f, user_id=2ea793243635476db3920ddf9be06382, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:32.224503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec8350-3285-41c3-a74c-f85a39fc1980 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:32.235214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1363/2693] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:32 2022] PUT /identity/v3/projects/17b3a2337c14424eb55c7a79f27f619f/users/2ea793243635476db3920ddf9be06382/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:32.299000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44def36-5c16-462c-beeb-5b252e695a66 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:32.299290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44def36-5c16-462c-beeb-5b252e695a66 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:32.299619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44def36-5c16-462c-beeb-5b252e695a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:32.327553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d44def36-5c16-462c-beeb-5b252e695a66 None None] MFA Rules not processed for user `2ea793243635476db3920ddf9be06382`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:32.328808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d44def36-5c16-462c-beeb-5b252e695a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:32.398432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1331/2694] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:32.409915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec8350-3285-41c3-a74c-f85a39fc1980 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:32.411646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-feec8350-3285-41c3-a74c-f85a39fc1980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:32.470870 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec8350-3285-41c3-a74c-f85a39fc1980 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:32.474639 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ac864-2d20-441a-80de-c6d08a194284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:32.475293 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ac864-2d20-441a-80de-c6d08a194284 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:32.475622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ac864-2d20-441a-80de-c6d08a194284 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:32.475901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ac864-2d20-441a-80de-c6d08a194284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:32.486363 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ac864-2d20-441a-80de-c6d08a194284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:32.487847 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ac864-2d20-441a-80de-c6d08a194284 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:32.497598 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1364/2695] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:32.565172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44def36-5c16-462c-beeb-5b252e695a66 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:32.627928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44def36-5c16-462c-beeb-5b252e695a66 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:32.632528 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:32.633445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:32.633721 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:32.633993 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] PATH_INFO: `/v3/users/1accc045b6214ad4818366f2deb73d9b` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:32.635188 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1accc045b6214ad4818366f2deb73d9b)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:32.637118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:32.653393 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:32.825371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1accc045b6214ad4818366f2deb73d9b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:32.833177 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1accc045b6214ad4818366f2deb73d9b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:32.891335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1accc045b6214ad4818366f2deb73d9b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:32.892390 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1accc045b6214ad4818366f2deb73d9b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:32.893070 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1accc045b6214ad4818366f2deb73d9b'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:32.911176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1332/2696] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:32 2022] DELETE /identity/v3/users/1accc045b6214ad4818366f2deb73d9b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:32.915750 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da35240-8c82-4da4-9d01-830e0ca1553d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:32.916213 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da35240-8c82-4da4-9d01-830e0ca1553d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:32.916332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da35240-8c82-4da4-9d01-830e0ca1553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:32.934007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-5da35240-8c82-4da4-9d01-830e0ca1553d None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:32.935217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-5da35240-8c82-4da4-9d01-830e0ca1553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:32.944234 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:33.001925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1365/2697] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:33.011941 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:33.013603 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:33.074518 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09012b0e-c56d-4def-9f11-9f9e3aa6e842 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:33.079055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a1eac-e8c2-4bba-8565-d3c81f5f8b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:33.079676 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a1eac-e8c2-4bba-8565-d3c81f5f8b95 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:33.079955 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a1eac-e8c2-4bba-8565-d3c81f5f8b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:33.080231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a1eac-e8c2-4bba-8565-d3c81f5f8b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:33.089953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a1eac-e8c2-4bba-8565-d3c81f5f8b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:33.091432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a1eac-e8c2-4bba-8565-d3c81f5f8b95 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:33.102466 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1333/2698] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:33.550471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da35240-8c82-4da4-9d01-830e0ca1553d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:33.551965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-5da35240-8c82-4da4-9d01-830e0ca1553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:33.565227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da35240-8c82-4da4-9d01-830e0ca1553d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:33.570487 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:33.571373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:33.571685 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:33.571964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] PATH_INFO: `/v3/projects/9d01af0629634f92a040e22fb019ab04` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:33.573177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d01af0629634f92a040e22fb019ab04)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:33.575118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:33.665276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d01af0629634f92a040e22fb019ab04', 'request_id': 'req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:33.671675 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d01af0629634f92a040e22fb019ab04', 'request_id': 'req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:33.677361 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d01af0629634f92a040e22fb019ab04', 'request_id': 'req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:33.748523 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] The token cache is being invalidate because project 9d01af0629634f92a040e22fb019ab04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:33.749296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:33.749939 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:33.751532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1366/2699] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:33 2022] DELETE /identity/v3/projects/9d01af0629634f92a040e22fb019ab04 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:33.755457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a1eac-e8c2-4bba-8565-d3c81f5f8b95 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:33.765280 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a1eac-e8c2-4bba-8565-d3c81f5f8b95 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:33.821888 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:33.822775 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:33.823058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:33.823332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] PATH_INFO: `/v3/users/2ea793243635476db3920ddf9be06382` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:33.824545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea793243635476db3920ddf9be06382)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:33.826448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:34.014876 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:34.021065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea793243635476db3920ddf9be06382'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:34.027940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea793243635476db3920ddf9be06382'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:34.109054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea793243635476db3920ddf9be06382'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:34.112425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea793243635476db3920ddf9be06382'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:34.112425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-1bcae5bc-96f7-4624-af40-bfe0575a7073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea793243635476db3920ddf9be06382'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:34.129386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1334/2700] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:33 2022] DELETE /identity/v3/users/2ea793243635476db3920ddf9be06382 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:34.537249 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:34.539032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:34.555603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e8e1a-f0d7-4d72-8f5e-087857f4c90b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:34.613890 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:34.614803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:34.615083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:34.615373 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] PATH_INFO: `/v3/projects/17b3a2337c14424eb55c7a79f27f619f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:34.616575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b3a2337c14424eb55c7a79f27f619f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:34.618462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:34.713043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:34.720595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b3a2337c14424eb55c7a79f27f619f', 'request_id': 'req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:34.726747 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b3a2337c14424eb55c7a79f27f619f', 'request_id': 'req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:34.732410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b3a2337c14424eb55c7a79f27f619f', 'request_id': 'req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:34.815926 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] The token cache is being invalidate because project 17b3a2337c14424eb55c7a79f27f619f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:34.816167 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:34.816802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b5d3ba3c-bccf-41d0-87bc-c5e819bae3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:34.818374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1367/2701] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:34 2022] DELETE /identity/v3/projects/17b3a2337c14424eb55c7a79f27f619f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:34.823474 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d54742-0e42-4996-8c0f-0639a0a63017 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:34.823956 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d54742-0e42-4996-8c0f-0639a0a63017 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:34.824055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d54742-0e42-4996-8c0f-0639a0a63017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:34.842629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-52d54742-0e42-4996-8c0f-0639a0a63017 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:34.844033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-52d54742-0e42-4996-8c0f-0639a0a63017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:34.903325 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1335/2702] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:34.911497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d824de-b6fd-4d7e-87b6-9912b3f2c8e8 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:34.911797 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d824de-b6fd-4d7e-87b6-9912b3f2c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:34.912230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d824de-b6fd-4d7e-87b6-9912b3f2c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:34.931611 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-06d824de-b6fd-4d7e-87b6-9912b3f2c8e8 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:34.932819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-06d824de-b6fd-4d7e-87b6-9912b3f2c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:34.941203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1368/2703] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:34.945416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d54742-0e42-4996-8c0f-0639a0a63017 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:34.955419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d54742-0e42-4996-8c0f-0639a0a63017 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:34.959937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc916a52-a3be-443d-a736-8be2b8f81c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:34.960593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc916a52-a3be-443d-a736-8be2b8f81c5f admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:34.960905 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc916a52-a3be-443d-a736-8be2b8f81c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:34.961151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc916a52-a3be-443d-a736-8be2b8f81c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:34.961871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc916a52-a3be-443d-a736-8be2b8f81c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:00:34.962184 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc916a52-a3be-443d-a736-8be2b8f81c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:34.963830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc916a52-a3be-443d-a736-8be2b8f81c5f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:34.976618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1336/2704] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 09:00:34.980953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d824de-b6fd-4d7e-87b6-9912b3f2c8e8 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:34.990922 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d824de-b6fd-4d7e-87b6-9912b3f2c8e8 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:34.995606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c013479-3026-4818-93e1-e139db0aa1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:34.996260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c013479-3026-4818-93e1-e139db0aa1be admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:34.996548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c013479-3026-4818-93e1-e139db0aa1be admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:34.996828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c013479-3026-4818-93e1-e139db0aa1be admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:34.997616 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c013479-3026-4818-93e1-e139db0aa1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:34.999562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c013479-3026-4818-93e1-e139db0aa1be admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:35.087823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1369/2705] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:34 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:35.091745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc916a52-a3be-443d-a736-8be2b8f81c5f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:35.102400 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc916a52-a3be-443d-a736-8be2b8f81c5f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:35.158532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436833e-26e8-4d55-88ca-31000b4d4711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:35.159203 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436833e-26e8-4d55-88ca-31000b4d4711 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:35.159522 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436833e-26e8-4d55-88ca-31000b4d4711 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:35.159805 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436833e-26e8-4d55-88ca-31000b4d4711 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:35.160502 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436833e-26e8-4d55-88ca-31000b4d4711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:35.162419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436833e-26e8-4d55-88ca-31000b4d4711 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:35.240663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1337/2706] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:35 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:35.244615 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c013479-3026-4818-93e1-e139db0aa1be admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:35.255107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c013479-3026-4818-93e1-e139db0aa1be admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:35.259741 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabbb5b-9dba-40e7-83fc-d402548144da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:35.260403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabbb5b-9dba-40e7-83fc-d402548144da admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:35.260688 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabbb5b-9dba-40e7-83fc-d402548144da admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:35.260968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabbb5b-9dba-40e7-83fc-d402548144da admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:35.261702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabbb5b-9dba-40e7-83fc-d402548144da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:35.263303 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabbb5b-9dba-40e7-83fc-d402548144da admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:35.274297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1370/2707] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:35.278352 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436833e-26e8-4d55-88ca-31000b4d4711 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:35.289190 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436833e-26e8-4d55-88ca-31000b4d4711 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:35.293795 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01777c6a-afea-4aea-af87-d9e7429b8695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:35.294483 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01777c6a-afea-4aea-af87-d9e7429b8695 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:35.294771 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01777c6a-afea-4aea-af87-d9e7429b8695 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:35.295053 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01777c6a-afea-4aea-af87-d9e7429b8695 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:35.295964 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01777c6a-afea-4aea-af87-d9e7429b8695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:35.297574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01777c6a-afea-4aea-af87-d9e7429b8695 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:35.307909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1338/2708] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:35.312655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabbb5b-9dba-40e7-83fc-d402548144da admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:35.322713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabbb5b-9dba-40e7-83fc-d402548144da admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:35.327976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408bcf5-ef64-453c-8338-4245ba143819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:35.328865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408bcf5-ef64-453c-8338-4245ba143819 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:35.329150 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408bcf5-ef64-453c-8338-4245ba143819 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:35.329431 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408bcf5-ef64-453c-8338-4245ba143819 admin admin] PATH_INFO: `/v3/projects/cfc81c2ef4d242b9a0d0d49f58a80017/users/636b195352b2499c8b337b0308ed41a0/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:35.347691 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408bcf5-ef64-453c-8338-4245ba143819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc81c2ef4d242b9a0d0d49f58a80017, user_id=636b195352b2499c8b337b0308ed41a0, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:35.350348 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408bcf5-ef64-453c-8338-4245ba143819 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:35.463865 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1371/2709] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:35 2022] PUT /identity/v3/projects/cfc81c2ef4d242b9a0d0d49f58a80017/users/636b195352b2499c8b337b0308ed41a0/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:35.474850 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650076ca-ca2c-48a7-97c5-75d6f4ad63da None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:35.475144 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650076ca-ca2c-48a7-97c5-75d6f4ad63da None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:35.475494 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650076ca-ca2c-48a7-97c5-75d6f4ad63da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:35.502584 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-650076ca-ca2c-48a7-97c5-75d6f4ad63da None None] MFA Rules not processed for user `636b195352b2499c8b337b0308ed41a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:35.503832 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-650076ca-ca2c-48a7-97c5-75d6f4ad63da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:35.513249 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:35.572037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1339/2710] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:35.577324 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408bcf5-ef64-453c-8338-4245ba143819 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:35.769344 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408bcf5-ef64-453c-8338-4245ba143819 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:35.774136 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2ff8-3c2b-4f46-8ce6-23e957fb7075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:35.774811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2ff8-3c2b-4f46-8ce6-23e957fb7075 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:35.775090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2ff8-3c2b-4f46-8ce6-23e957fb7075 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:35.775388 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2ff8-3c2b-4f46-8ce6-23e957fb7075 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:35.776086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e2ff8-3c2b-4f46-8ce6-23e957fb7075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:35.778016 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e2ff8-3c2b-4f46-8ce6-23e957fb7075 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:35.848579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1372/2711] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:35 2022] POST /identity/v3/projects => generated 363 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:35.852631 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650076ca-ca2c-48a7-97c5-75d6f4ad63da None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:35.866676 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650076ca-ca2c-48a7-97c5-75d6f4ad63da None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:35.924920 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49960a72-452c-4e8c-a336-629cfee6591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:35.925600 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49960a72-452c-4e8c-a336-629cfee6591f admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:35.925885 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49960a72-452c-4e8c-a336-629cfee6591f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:35.926193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49960a72-452c-4e8c-a336-629cfee6591f admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:35.926893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49960a72-452c-4e8c-a336-629cfee6591f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:35.928853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49960a72-452c-4e8c-a336-629cfee6591f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:36.001228 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1340/2712] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:35 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:36.005529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2ff8-3c2b-4f46-8ce6-23e957fb7075 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:36.015987 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2ff8-3c2b-4f46-8ce6-23e957fb7075 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:36.020746 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c943e7f-2c63-43eb-a14e-78a967ab8cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:36.021354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c943e7f-2c63-43eb-a14e-78a967ab8cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:36.021684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c943e7f-2c63-43eb-a14e-78a967ab8cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:36.021966 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c943e7f-2c63-43eb-a14e-78a967ab8cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:36.022698 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c943e7f-2c63-43eb-a14e-78a967ab8cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:36.024334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c943e7f-2c63-43eb-a14e-78a967ab8cb1 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:36.035265 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1373/2713] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 09:00:36.039649 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49960a72-452c-4e8c-a336-629cfee6591f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:36.050719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49960a72-452c-4e8c-a336-629cfee6591f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:36.055612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dbf14-30df-419a-8bd9-fb93958a6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:36.056507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dbf14-30df-419a-8bd9-fb93958a6b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:36.056791 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dbf14-30df-419a-8bd9-fb93958a6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:36.057069 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dbf14-30df-419a-8bd9-fb93958a6b58 admin admin] PATH_INFO: `/v3/projects/79a9356cc1a04346855dec7f3bae14c7/users/a955bbff05a844b2ab69d3237d8ad9e9/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:36.073953 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dbf14-30df-419a-8bd9-fb93958a6b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a9356cc1a04346855dec7f3bae14c7, user_id=a955bbff05a844b2ab69d3237d8ad9e9, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:36.076816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dbf14-30df-419a-8bd9-fb93958a6b58 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:36.178623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1341/2714] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:36 2022] PUT /identity/v3/projects/79a9356cc1a04346855dec7f3bae14c7/users/a955bbff05a844b2ab69d3237d8ad9e9/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:36.183055 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c943e7f-2c63-43eb-a14e-78a967ab8cb1 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:36.193849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c943e7f-2c63-43eb-a14e-78a967ab8cb1 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:36.225984 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:36.250356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75766670-d621-4d7c-966d-3dc9fb83010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:36.251232 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75766670-d621-4d7c-966d-3dc9fb83010f admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:36.251796 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75766670-d621-4d7c-966d-3dc9fb83010f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:36.252534 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75766670-d621-4d7c-966d-3dc9fb83010f admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:36.253230 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75766670-d621-4d7c-966d-3dc9fb83010f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:36.254956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75766670-d621-4d7c-966d-3dc9fb83010f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:36.264995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1374/2715] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:36.269178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dbf14-30df-419a-8bd9-fb93958a6b58 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:36.279455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dbf14-30df-419a-8bd9-fb93958a6b58 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:36.283933 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0504310-3268-4ba7-9cbc-6078d3e98b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:36.284807 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0504310-3268-4ba7-9cbc-6078d3e98b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:36.285090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0504310-3268-4ba7-9cbc-6078d3e98b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:36.285365 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0504310-3268-4ba7-9cbc-6078d3e98b28 admin admin] PATH_INFO: `/v3/projects/79a9356cc1a04346855dec7f3bae14c7/users/a955bbff05a844b2ab69d3237d8ad9e9/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:36.287314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0504310-3268-4ba7-9cbc-6078d3e98b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a9356cc1a04346855dec7f3bae14c7, user_id=a955bbff05a844b2ab69d3237d8ad9e9, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:36.289980 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0504310-3268-4ba7-9cbc-6078d3e98b28 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:36.302023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1342/2716] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:36 2022] PUT /identity/v3/projects/79a9356cc1a04346855dec7f3bae14c7/users/a955bbff05a844b2ab69d3237d8ad9e9/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:36.320378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e6bd-7d34-46c3-b9ad-413d01c9fcb7 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:36.320652 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e6bd-7d34-46c3-b9ad-413d01c9fcb7 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:36.320925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e6bd-7d34-46c3-b9ad-413d01c9fcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:36.347064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-6880e6bd-7d34-46c3-b9ad-413d01c9fcb7 None None] MFA Rules not processed for user `a955bbff05a844b2ab69d3237d8ad9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:36.348306 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-6880e6bd-7d34-46c3-b9ad-413d01c9fcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:36.417721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1375/2717] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:36.429839 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0504310-3268-4ba7-9cbc-6078d3e98b28 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:36.431812 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-b0504310-3268-4ba7-9cbc-6078d3e98b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:36.493161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0504310-3268-4ba7-9cbc-6078d3e98b28 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:36.497029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43126c7f-d1c0-42e6-9c6c-20eaf9358cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:36.497713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43126c7f-d1c0-42e6-9c6c-20eaf9358cfa service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:36.497996 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43126c7f-d1c0-42e6-9c6c-20eaf9358cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:36.498282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43126c7f-d1c0-42e6-9c6c-20eaf9358cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:36.508304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43126c7f-d1c0-42e6-9c6c-20eaf9358cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:36.509772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43126c7f-d1c0-42e6-9c6c-20eaf9358cfa service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:36.520404 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1343/2718] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 09:00:36.705146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e6bd-7d34-46c3-b9ad-413d01c9fcb7 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:36.715108 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e6bd-7d34-46c3-b9ad-413d01c9fcb7 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:36.719863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e90f3-30b0-40b0-92e4-973abb324dfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:36.720543 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e90f3-30b0-40b0-92e4-973abb324dfe service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:36.720834 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e90f3-30b0-40b0-92e4-973abb324dfe service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:36.721135 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e90f3-30b0-40b0-92e4-973abb324dfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:36.777986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e90f3-30b0-40b0-92e4-973abb324dfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:36.779457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e90f3-30b0-40b0-92e4-973abb324dfe service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:36.789493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1376/2719] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:43.020774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43126c7f-d1c0-42e6-9c6c-20eaf9358cfa service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:43.029752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:43.083971 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43126c7f-d1c0-42e6-9c6c-20eaf9358cfa service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:43.088693 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:43.089551 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:43.089828 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:43.090146 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] PATH_INFO: `/v3/users/636b195352b2499c8b337b0308ed41a0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:43.091299 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=636b195352b2499c8b337b0308ed41a0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:43.093967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:43.284545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636b195352b2499c8b337b0308ed41a0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:43.292041 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636b195352b2499c8b337b0308ed41a0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:43.388763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636b195352b2499c8b337b0308ed41a0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:43.389489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636b195352b2499c8b337b0308ed41a0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:43.390336 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636b195352b2499c8b337b0308ed41a0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:43.409766 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1344/2720] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:43 2022] DELETE /identity/v3/users/636b195352b2499c8b337b0308ed41a0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:43.414346 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478492d8-fe4a-45c8-ad59-bc426a2250d9 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:43.414854 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478492d8-fe4a-45c8-ad59-bc426a2250d9 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:43.414955 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478492d8-fe4a-45c8-ad59-bc426a2250d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:43.433312 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-478492d8-fe4a-45c8-ad59-bc426a2250d9 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:43.434508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-478492d8-fe4a-45c8-ad59-bc426a2250d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:43.485017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:43.494394 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1377/2721] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:43.504427 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:43.505856 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:43.565982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c97c8b-f94b-41a4-8df4-c386c933d62d admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:43.569553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b13bc-966a-4029-8178-984e227945f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:43.570192 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b13bc-966a-4029-8178-984e227945f3 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:43.570473 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b13bc-966a-4029-8178-984e227945f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:43.570747 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b13bc-966a-4029-8178-984e227945f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:43.580688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b13bc-966a-4029-8178-984e227945f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:43.582841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b13bc-966a-4029-8178-984e227945f3 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:43.591779 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1345/2722] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:44.029906 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478492d8-fe4a-45c8-ad59-bc426a2250d9 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:44.031430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-478492d8-fe4a-45c8-ad59-bc426a2250d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:44.043297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478492d8-fe4a-45c8-ad59-bc426a2250d9 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:44.048226 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:44.049154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:44.049430 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:44.049705 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] PATH_INFO: `/v3/projects/cfc81c2ef4d242b9a0d0d49f58a80017` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:44.050892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc81c2ef4d242b9a0d0d49f58a80017)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:44.052822 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:44.167110 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc81c2ef4d242b9a0d0d49f58a80017', 'request_id': 'req-7241dce1-f2b1-41fe-a621-526e3fede8e8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:44.173518 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc81c2ef4d242b9a0d0d49f58a80017', 'request_id': 'req-7241dce1-f2b1-41fe-a621-526e3fede8e8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:44.179205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc81c2ef4d242b9a0d0d49f58a80017', 'request_id': 'req-7241dce1-f2b1-41fe-a621-526e3fede8e8'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:44.262647 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] The token cache is being invalidate because project cfc81c2ef4d242b9a0d0d49f58a80017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:44.262958 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:44.263638 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:44.265188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1378/2723] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:44 2022] DELETE /identity/v3/projects/cfc81c2ef4d242b9a0d0d49f58a80017 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:44.269308 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b13bc-966a-4029-8178-984e227945f3 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:44.278942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b13bc-966a-4029-8178-984e227945f3 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:44.307749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:44.339314 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:44.340244 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:44.340637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:44.340914 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] PATH_INFO: `/v3/users/a955bbff05a844b2ab69d3237d8ad9e9` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:44.342130 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a955bbff05a844b2ab69d3237d8ad9e9)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:44.344114 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:44.583577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a955bbff05a844b2ab69d3237d8ad9e9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:44.590296 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a955bbff05a844b2ab69d3237d8ad9e9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:44.669011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a955bbff05a844b2ab69d3237d8ad9e9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:44.669631 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a955bbff05a844b2ab69d3237d8ad9e9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:44.670799 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f58b69a9-000d-4cdb-b6d6-9e1ba825845e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a955bbff05a844b2ab69d3237d8ad9e9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:44.690095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1346/2724] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:44 2022] DELETE /identity/v3/users/a955bbff05a844b2ab69d3237d8ad9e9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:45.122090 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:45.124644 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:45.138358 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241dce1-f2b1-41fe-a621-526e3fede8e8 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:45.197471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:45.198337 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:45.198618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:45.198892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] PATH_INFO: `/v3/projects/79a9356cc1a04346855dec7f3bae14c7` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:45.200076 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a9356cc1a04346855dec7f3bae14c7)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:45.202233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:45.323136 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a9356cc1a04346855dec7f3bae14c7', 'request_id': 'req-8060571a-941b-4020-bc83-49f18c3bf3b4'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:45.329633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a9356cc1a04346855dec7f3bae14c7', 'request_id': 'req-8060571a-941b-4020-bc83-49f18c3bf3b4'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:45.335503 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a9356cc1a04346855dec7f3bae14c7', 'request_id': 'req-8060571a-941b-4020-bc83-49f18c3bf3b4'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:45.427562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] The token cache is being invalidate because project 79a9356cc1a04346855dec7f3bae14c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:45.427850 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:45.428474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-8060571a-941b-4020-bc83-49f18c3bf3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:45.430019 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1379/2725] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:45 2022] DELETE /identity/v3/projects/79a9356cc1a04346855dec7f3bae14c7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:45.435822 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fc86f-0e92-4ea1-96b6-f02efe0fcab7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:45.436348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fc86f-0e92-4ea1-96b6-f02efe0fcab7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:45.436641 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fc86f-0e92-4ea1-96b6-f02efe0fcab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:45.455623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-247fc86f-0e92-4ea1-96b6-f02efe0fcab7 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:45.456878 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-247fc86f-0e92-4ea1-96b6-f02efe0fcab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:45.518716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1347/2726] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:45.526457 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471087-dbd7-43bc-b482-d49c710f8374 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:45.526744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471087-dbd7-43bc-b482-d49c710f8374 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:45.527021 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471087-dbd7-43bc-b482-d49c710f8374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:45.546985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1e471087-dbd7-43bc-b482-d49c710f8374 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:45.548224 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1e471087-dbd7-43bc-b482-d49c710f8374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:45.556859 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1380/2727] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:45.561246 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fc86f-0e92-4ea1-96b6-f02efe0fcab7 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:45.571291 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fc86f-0e92-4ea1-96b6-f02efe0fcab7 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:45.576306 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ba941-5653-482f-bde4-82ef31f8ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:45.577003 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ba941-5653-482f-bde4-82ef31f8ea4f admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:45.577236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ba941-5653-482f-bde4-82ef31f8ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:45.577521 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ba941-5653-482f-bde4-82ef31f8ea4f admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:45.578258 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ba941-5653-482f-bde4-82ef31f8ea4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:00:45.578586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ba941-5653-482f-bde4-82ef31f8ea4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:45.580265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ba941-5653-482f-bde4-82ef31f8ea4f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:45.593418 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1348/2728] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 09:00:45.597537 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e471087-dbd7-43bc-b482-d49c710f8374 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:45.603177 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:45.607036 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e471087-dbd7-43bc-b482-d49c710f8374 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:45.612601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353caf8-933f-4a05-8718-7fec835b9903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:45.613414 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353caf8-933f-4a05-8718-7fec835b9903 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:45.613697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353caf8-933f-4a05-8718-7fec835b9903 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:45.613971 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353caf8-933f-4a05-8718-7fec835b9903 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:45.614670 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353caf8-933f-4a05-8718-7fec835b9903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:45.616809 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353caf8-933f-4a05-8718-7fec835b9903 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:45.731975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1381/2729] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:45 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:45.733491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ba941-5653-482f-bde4-82ef31f8ea4f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:45.744225 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ba941-5653-482f-bde4-82ef31f8ea4f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:45.783823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:45.809947 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3975d-ce8e-4e6b-94a2-27755cb5a775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:45.810673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3975d-ce8e-4e6b-94a2-27755cb5a775 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:45.810997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3975d-ce8e-4e6b-94a2-27755cb5a775 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:45.811248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3975d-ce8e-4e6b-94a2-27755cb5a775 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:45.811986 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3975d-ce8e-4e6b-94a2-27755cb5a775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:45.813983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3975d-ce8e-4e6b-94a2-27755cb5a775 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:45.939504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1349/2730] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:45 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:45.943892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353caf8-933f-4a05-8718-7fec835b9903 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:45.954995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353caf8-933f-4a05-8718-7fec835b9903 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:45.959572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a394-b0ec-4233-ab41-d1e82f45b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:45.960240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a394-b0ec-4233-ab41-d1e82f45b506 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:45.960524 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a394-b0ec-4233-ab41-d1e82f45b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:45.960803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398a394-b0ec-4233-ab41-d1e82f45b506 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:45.961532 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398a394-b0ec-4233-ab41-d1e82f45b506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:45.963124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398a394-b0ec-4233-ab41-d1e82f45b506 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:45.973915 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1382/2731] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 09:00:45.978050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3975d-ce8e-4e6b-94a2-27755cb5a775 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:45.988446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3975d-ce8e-4e6b-94a2-27755cb5a775 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:45.993207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612fd2f-4b4f-4660-bb03-ddd4adf3ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:45.993880 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612fd2f-4b4f-4660-bb03-ddd4adf3ef62 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:45.994160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612fd2f-4b4f-4660-bb03-ddd4adf3ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:45.994433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612fd2f-4b4f-4660-bb03-ddd4adf3ef62 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:45.995198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612fd2f-4b4f-4660-bb03-ddd4adf3ef62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:45.996861 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612fd2f-4b4f-4660-bb03-ddd4adf3ef62 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:46.007833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1350/2732] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:46.012154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a394-b0ec-4233-ab41-d1e82f45b506 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:46.022838 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398a394-b0ec-4233-ab41-d1e82f45b506 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:46.027689 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ae382-19a6-4847-a28c-d935e857899f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:46.032743 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ae382-19a6-4847-a28c-d935e857899f admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:46.032743 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ae382-19a6-4847-a28c-d935e857899f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:46.032743 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ae382-19a6-4847-a28c-d935e857899f admin admin] PATH_INFO: `/v3/projects/d0eb6441b26f4a029b1da2742b0a883e/users/e7b90aa9f3d44f0b96d376dc1876580d/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:46.045045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ae382-19a6-4847-a28c-d935e857899f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0eb6441b26f4a029b1da2742b0a883e, user_id=e7b90aa9f3d44f0b96d376dc1876580d, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:46.047874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ae382-19a6-4847-a28c-d935e857899f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:46.137999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1383/2733] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:46 2022] PUT /identity/v3/projects/d0eb6441b26f4a029b1da2742b0a883e/users/e7b90aa9f3d44f0b96d376dc1876580d/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:46.149160 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84bb41-c0d3-4914-a64a-ecf73d9cd334 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:46.149448 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84bb41-c0d3-4914-a64a-ecf73d9cd334 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:46.149730 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84bb41-c0d3-4914-a64a-ecf73d9cd334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:46.176208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-ac84bb41-c0d3-4914-a64a-ecf73d9cd334 None None] MFA Rules not processed for user `e7b90aa9f3d44f0b96d376dc1876580d`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:46.177424 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ac84bb41-c0d3-4914-a64a-ecf73d9cd334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:46.242461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1351/2734] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:46.247042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ae382-19a6-4847-a28c-d935e857899f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:46.324730 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ae382-19a6-4847-a28c-d935e857899f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:46.330319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb50091-6114-4d9b-bc4f-92bb0868de16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:46.330985 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb50091-6114-4d9b-bc4f-92bb0868de16 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:46.331268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb50091-6114-4d9b-bc4f-92bb0868de16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:46.331581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb50091-6114-4d9b-bc4f-92bb0868de16 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:46.332281 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb50091-6114-4d9b-bc4f-92bb0868de16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:46.334269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb50091-6114-4d9b-bc4f-92bb0868de16 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:46.430967 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1384/2735] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:46 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:46.433982 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84bb41-c0d3-4914-a64a-ecf73d9cd334 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:46.449150 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84bb41-c0d3-4914-a64a-ecf73d9cd334 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:46.511301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc4b3e-ab6f-4150-bf23-23e82a980aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:46.512011 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc4b3e-ab6f-4150-bf23-23e82a980aac admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:46.512298 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc4b3e-ab6f-4150-bf23-23e82a980aac admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:46.512626 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc4b3e-ab6f-4150-bf23-23e82a980aac admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:46.513327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc4b3e-ab6f-4150-bf23-23e82a980aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:46.515810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc4b3e-ab6f-4150-bf23-23e82a980aac admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:46.606553 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1352/2736] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:46 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:46.611367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb50091-6114-4d9b-bc4f-92bb0868de16 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:46.622835 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb50091-6114-4d9b-bc4f-92bb0868de16 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:46.628808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88815f-12b2-4705-a03e-58654a484825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:46.629478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88815f-12b2-4705-a03e-58654a484825 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:46.629762 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88815f-12b2-4705-a03e-58654a484825 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:46.630040 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88815f-12b2-4705-a03e-58654a484825 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:46.630769 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88815f-12b2-4705-a03e-58654a484825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:46.632413 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88815f-12b2-4705-a03e-58654a484825 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:46.643547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1385/2737] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:46.647729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc4b3e-ab6f-4150-bf23-23e82a980aac admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:46.658398 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc4b3e-ab6f-4150-bf23-23e82a980aac admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:46.663050 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27111-ffe4-4001-810e-76949c094ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:46.663764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27111-ffe4-4001-810e-76949c094ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:46.664048 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27111-ffe4-4001-810e-76949c094ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:46.664327 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27111-ffe4-4001-810e-76949c094ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:46.665055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c27111-ffe4-4001-810e-76949c094ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:46.666754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c27111-ffe4-4001-810e-76949c094ec9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:46.678354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1353/2738] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:46.682774 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88815f-12b2-4705-a03e-58654a484825 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:46.693805 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88815f-12b2-4705-a03e-58654a484825 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:46.698632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05658da5-0911-46e3-a323-1c3ef88836d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:46.699839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05658da5-0911-46e3-a323-1c3ef88836d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:46.699839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05658da5-0911-46e3-a323-1c3ef88836d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:46.700086 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05658da5-0911-46e3-a323-1c3ef88836d9 admin admin] PATH_INFO: `/v3/projects/32d6609997d54e67a742d0e9dd583f0d/users/79e7daf8f18b4c0e881a7111096b6143/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:46.715783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05658da5-0911-46e3-a323-1c3ef88836d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d6609997d54e67a742d0e9dd583f0d, user_id=79e7daf8f18b4c0e881a7111096b6143, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:46.718761 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05658da5-0911-46e3-a323-1c3ef88836d9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:46.795259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1386/2739] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:46 2022] PUT /identity/v3/projects/32d6609997d54e67a742d0e9dd583f0d/users/79e7daf8f18b4c0e881a7111096b6143/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 09:00:46.808362 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ef153-7b60-44bf-ae11-ba18e29f675a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:46.808661 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ef153-7b60-44bf-ae11-ba18e29f675a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:46.809009 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ef153-7b60-44bf-ae11-ba18e29f675a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:46.838312 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d90ef153-7b60-44bf-ae11-ba18e29f675a None None] MFA Rules not processed for user `79e7daf8f18b4c0e881a7111096b6143`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:46.839574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d90ef153-7b60-44bf-ae11-ba18e29f675a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:46.850264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:46.909613 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1354/2740] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 09:00:46.915299 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05658da5-0911-46e3-a323-1c3ef88836d9 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:46.976188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:46.980064 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05658da5-0911-46e3-a323-1c3ef88836d9 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:46.987209 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c37c4-9db4-4849-8be5-a329894ea87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:46.987991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c37c4-9db4-4849-8be5-a329894ea87f admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:46.988270 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c37c4-9db4-4849-8be5-a329894ea87f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:46.988545 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c37c4-9db4-4849-8be5-a329894ea87f admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:46.989437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c37c4-9db4-4849-8be5-a329894ea87f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:46.991655 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c37c4-9db4-4849-8be5-a329894ea87f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:47.195238 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1387/2741] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:00:46 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:47.199445 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ef153-7b60-44bf-ae11-ba18e29f675a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:47.210694 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ef153-7b60-44bf-ae11-ba18e29f675a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:47.266841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687c1ec-b5d3-48f2-85ec-54dc0dc229e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:47.267532 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687c1ec-b5d3-48f2-85ec-54dc0dc229e9 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:47.267814 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687c1ec-b5d3-48f2-85ec-54dc0dc229e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:47.268091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687c1ec-b5d3-48f2-85ec-54dc0dc229e9 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:47.268778 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687c1ec-b5d3-48f2-85ec-54dc0dc229e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:47.270703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687c1ec-b5d3-48f2-85ec-54dc0dc229e9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:47.370358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1355/2742] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:00:47 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:00:47.374340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c37c4-9db4-4849-8be5-a329894ea87f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:47.385161 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c37c4-9db4-4849-8be5-a329894ea87f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:47.390070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8431b-1182-4029-9438-17f9f8b901b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:47.390741 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8431b-1182-4029-9438-17f9f8b901b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:47.391593 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8431b-1182-4029-9438-17f9f8b901b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:47.391999 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8431b-1182-4029-9438-17f9f8b901b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:47.392737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8431b-1182-4029-9438-17f9f8b901b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:47.394376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8431b-1182-4029-9438-17f9f8b901b7 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:47.406756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1388/2743] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:47.417358 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687c1ec-b5d3-48f2-85ec-54dc0dc229e9 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:47.427973 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687c1ec-b5d3-48f2-85ec-54dc0dc229e9 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:47.433209 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c07706-affd-483e-8a97-5484c7761fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:47.434113 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07706-affd-483e-8a97-5484c7761fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:47.434402 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07706-affd-483e-8a97-5484c7761fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:47.434683 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07706-affd-483e-8a97-5484c7761fb1 admin admin] PATH_INFO: `/v3/projects/d749f6cc54094ef3ba5c66a4a64f90f4/users/bb2b20a1860d488d88687743b025502e/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:47.452045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c07706-affd-483e-8a97-5484c7761fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d749f6cc54094ef3ba5c66a4a64f90f4, user_id=bb2b20a1860d488d88687743b025502e, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:47.454700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c07706-affd-483e-8a97-5484c7761fb1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:47.514737 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1356/2744] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:47 2022] PUT /identity/v3/projects/d749f6cc54094ef3ba5c66a4a64f90f4/users/bb2b20a1860d488d88687743b025502e/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:47.519876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8431b-1182-4029-9438-17f9f8b901b7 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:47.530124 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8431b-1182-4029-9438-17f9f8b901b7 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:47.587526 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeac82-74c0-4bd8-bce0-49a02d9b2ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:47.588231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeac82-74c0-4bd8-bce0-49a02d9b2ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:47.588520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeac82-74c0-4bd8-bce0-49a02d9b2ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:47.588798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeac82-74c0-4bd8-bce0-49a02d9b2ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:47.589552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeac82-74c0-4bd8-bce0-49a02d9b2ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:47.591174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeac82-74c0-4bd8-bce0-49a02d9b2ae6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:47.602027 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1389/2745] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:00:47.606333 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c07706-affd-483e-8a97-5484c7761fb1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:47.616720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c07706-affd-483e-8a97-5484c7761fb1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:47.621285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5edb15-2506-4d8d-9bc6-8080b1063f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:47.622164 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5edb15-2506-4d8d-9bc6-8080b1063f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:47.622444 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5edb15-2506-4d8d-9bc6-8080b1063f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:47.622719 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5edb15-2506-4d8d-9bc6-8080b1063f76 admin admin] PATH_INFO: `/v3/projects/d749f6cc54094ef3ba5c66a4a64f90f4/users/bb2b20a1860d488d88687743b025502e/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:47.624690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5edb15-2506-4d8d-9bc6-8080b1063f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d749f6cc54094ef3ba5c66a4a64f90f4, user_id=bb2b20a1860d488d88687743b025502e, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:47.628199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5edb15-2506-4d8d-9bc6-8080b1063f76 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:47.638869 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1357/2746] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:00:47 2022] PUT /identity/v3/projects/d749f6cc54094ef3ba5c66a4a64f90f4/users/bb2b20a1860d488d88687743b025502e/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:47.650186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1130dd-9fc2-415b-8653-afd58351329d None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:47.650477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1130dd-9fc2-415b-8653-afd58351329d None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:47.650759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1130dd-9fc2-415b-8653-afd58351329d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:47.677925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-1d1130dd-9fc2-415b-8653-afd58351329d None None] MFA Rules not processed for user `bb2b20a1860d488d88687743b025502e`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:47.679173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1d1130dd-9fc2-415b-8653-afd58351329d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:47.751543 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1390/2747] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 09:00:47.762901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5edb15-2506-4d8d-9bc6-8080b1063f76 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:47.765586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8b5edb15-2506-4d8d-9bc6-8080b1063f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:47.825968 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5edb15-2506-4d8d-9bc6-8080b1063f76 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:47.830254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eee22-f34a-420b-b289-4dfcb52857da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:47.830903 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eee22-f34a-420b-b289-4dfcb52857da service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:47.831191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eee22-f34a-420b-b289-4dfcb52857da service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:47.831510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eee22-f34a-420b-b289-4dfcb52857da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:47.848283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:47.887378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70eee22-f34a-420b-b289-4dfcb52857da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:47.888851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70eee22-f34a-420b-b289-4dfcb52857da service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:47.899101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1358/2748] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:49.795432 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1130dd-9fc2-415b-8653-afd58351329d None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:49.806217 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1130dd-9fc2-415b-8653-afd58351329d None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:49.809819 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d312f6-3482-49da-9c6a-341e282f918e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:49.810577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d312f6-3482-49da-9c6a-341e282f918e service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:49.810860 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d312f6-3482-49da-9c6a-341e282f918e service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:49.811163 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d312f6-3482-49da-9c6a-341e282f918e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:49.858500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:49.867848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d312f6-3482-49da-9c6a-341e282f918e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:49.869288 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d312f6-3482-49da-9c6a-341e282f918e service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:49.878180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1391/2749] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:51.264206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eee22-f34a-420b-b289-4dfcb52857da service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:51.273516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eee22-f34a-420b-b289-4dfcb52857da service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:51.277287 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a709d-7b01-41bb-ab45-06a16f618e81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:51.277926 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a709d-7b01-41bb-ab45-06a16f618e81 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:51.278211 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a709d-7b01-41bb-ab45-06a16f618e81 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:51.278489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a709d-7b01-41bb-ab45-06a16f618e81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:51.288467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a709d-7b01-41bb-ab45-06a16f618e81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:51.289967 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a709d-7b01-41bb-ab45-06a16f618e81 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:51.301157 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1359/2750] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:53.843786 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5ab68-ad55-43c7-a581-62f7f0338c35 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:53.846329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5ab68-ad55-43c7-a581-62f7f0338c35 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:53.846329 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5ab68-ad55-43c7-a581-62f7f0338c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:53.863091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-51c5ab68-ad55-43c7-a581-62f7f0338c35 None None] MFA Rules not processed for user `61c06d41d371486c9856a17c5b2aee20`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:53.864315 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-51c5ab68-ad55-43c7-a581-62f7f0338c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:53.919558 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1392/2751] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:56.089000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a709d-7b01-41bb-ab45-06a16f618e81 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:56.169972 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a709d-7b01-41bb-ab45-06a16f618e81 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:56.175421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:56.176462 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:56.176811 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:56.177090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] PATH_INFO: `/v3/users/e7b90aa9f3d44f0b96d376dc1876580d` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:56.178284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b90aa9f3d44f0b96d376dc1876580d)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:56.180491 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:56.408566 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b90aa9f3d44f0b96d376dc1876580d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:56.415326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b90aa9f3d44f0b96d376dc1876580d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:56.541262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b90aa9f3d44f0b96d376dc1876580d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:56.542153 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b90aa9f3d44f0b96d376dc1876580d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:56.542770 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b90aa9f3d44f0b96d376dc1876580d'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:56.570318 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1360/2752] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:56 2022] DELETE /identity/v3/users/e7b90aa9f3d44f0b96d376dc1876580d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:56.570502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2066dc-1102-4db6-ba37-1424a28b22a4 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:56.570502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2066dc-1102-4db6-ba37-1424a28b22a4 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:56.570502 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2066dc-1102-4db6-ba37-1424a28b22a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:56.586180 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-3d2066dc-1102-4db6-ba37-1424a28b22a4 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:00:56.587536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3d2066dc-1102-4db6-ba37-1424a28b22a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:56.647576 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1393/2753] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:00:56.658125 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:56.659576 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:56.689087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:56.717990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7565ea-e655-45b6-8c3a-86f67531c4ac admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:56.722691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094e1db-9a98-4ef9-8200-f64ce878aadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:56.722913 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e1db-9a98-4ef9-8200-f64ce878aadd service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:56.723194 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e1db-9a98-4ef9-8200-f64ce878aadd service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:56.723571 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e1db-9a98-4ef9-8200-f64ce878aadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:56.732823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094e1db-9a98-4ef9-8200-f64ce878aadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:56.734237 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094e1db-9a98-4ef9-8200-f64ce878aadd service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:56.744663 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1361/2754] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:00:57.179186 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2066dc-1102-4db6-ba37-1424a28b22a4 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:57.180925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3d2066dc-1102-4db6-ba37-1424a28b22a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:57.193440 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2066dc-1102-4db6-ba37-1424a28b22a4 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:57.198779 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:57.199918 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:57.200202 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:57.200478 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] PATH_INFO: `/v3/projects/d0eb6441b26f4a029b1da2742b0a883e` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:57.202053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0eb6441b26f4a029b1da2742b0a883e)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:57.204903 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:57.378235 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0eb6441b26f4a029b1da2742b0a883e', 'request_id': 'req-82e84cfd-7bb8-4981-a84d-ff240f0521ff'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:57.385886 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0eb6441b26f4a029b1da2742b0a883e', 'request_id': 'req-82e84cfd-7bb8-4981-a84d-ff240f0521ff'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:57.396831 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0eb6441b26f4a029b1da2742b0a883e', 'request_id': 'req-82e84cfd-7bb8-4981-a84d-ff240f0521ff'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:57.476253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] The token cache is being invalidate because project d0eb6441b26f4a029b1da2742b0a883e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:57.480133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:57.480133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:57.480133 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1394/2755] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:57 2022] DELETE /identity/v3/projects/d0eb6441b26f4a029b1da2742b0a883e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:57.482753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094e1db-9a98-4ef9-8200-f64ce878aadd service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:57.493208 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094e1db-9a98-4ef9-8200-f64ce878aadd service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:57.557599 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:57.558588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:57.559135 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:57.559530 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] PATH_INFO: `/v3/users/79e7daf8f18b4c0e881a7111096b6143` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:57.560851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e7daf8f18b4c0e881a7111096b6143)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:57.563295 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:57.751749 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e7daf8f18b4c0e881a7111096b6143'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:57.759670 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e7daf8f18b4c0e881a7111096b6143'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:57.838718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e7daf8f18b4c0e881a7111096b6143'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:57.839387 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e7daf8f18b4c0e881a7111096b6143'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:57.840006 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e7daf8f18b4c0e881a7111096b6143'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:57.859930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1362/2756] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:57 2022] DELETE /identity/v3/users/79e7daf8f18b4c0e881a7111096b6143 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:58.372851 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:58.377006 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:58.399072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e84cfd-7bb8-4981-a84d-ff240f0521ff admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:58.430953 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:58.512992 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:58.515808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:58.516504 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:58.517146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] PATH_INFO: `/v3/projects/32d6609997d54e67a742d0e9dd583f0d` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:58.526497 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d6609997d54e67a742d0e9dd583f0d)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:58.528997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:58.790137 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d6609997d54e67a742d0e9dd583f0d', 'request_id': 'req-ad0c2ebe-740a-4938-9db0-41939a0d2486'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:58.796508 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d6609997d54e67a742d0e9dd583f0d', 'request_id': 'req-ad0c2ebe-740a-4938-9db0-41939a0d2486'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:58.804667 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d6609997d54e67a742d0e9dd583f0d', 'request_id': 'req-ad0c2ebe-740a-4938-9db0-41939a0d2486'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:58.886280 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] The token cache is being invalidate because project 32d6609997d54e67a742d0e9dd583f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:00:58.886583 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:58.887602 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:58.889295 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1395/2757] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:00:58 2022] DELETE /identity/v3/projects/32d6609997d54e67a742d0e9dd583f0d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:00:58.893526 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:00:58.895578 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:00:58.911103 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96869be-631c-460a-934c-72dc0ea83cb1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:00:58.966608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:00:58.983170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:00:58.984097 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:00:58.984392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:00:58.985531 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] PATH_INFO: `/v3/users/bb2b20a1860d488d88687743b025502e` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:00:58.986847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2b20a1860d488d88687743b025502e)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:00:58.990431 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:00:59.263217 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2b20a1860d488d88687743b025502e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:59.273754 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2b20a1860d488d88687743b025502e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:59.394482 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2b20a1860d488d88687743b025502e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:59.395094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2b20a1860d488d88687743b025502e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:59.395853 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2b20a1860d488d88687743b025502e'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:00:59.428154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1363/2758] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:00:58 2022] DELETE /identity/v3/users/bb2b20a1860d488d88687743b025502e => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 09:01:00.059280 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:01:00.060899 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:01:00.074722 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c2ebe-740a-4938-9db0-41939a0d2486 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:01:00.137924 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:01:00.138787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:01:00.139068 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:01:00.139341 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] PATH_INFO: `/v3/projects/d749f6cc54094ef3ba5c66a4a64f90f4` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:01:00.140543 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d749f6cc54094ef3ba5c66a4a64f90f4)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:01:00.143042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:01:00.258454 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd749f6cc54094ef3ba5c66a4a64f90f4', 'request_id': 'req-36142876-a036-42fb-b593-8f7b185a301b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:01:00.260377 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:00.264798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd749f6cc54094ef3ba5c66a4a64f90f4', 'request_id': 'req-36142876-a036-42fb-b593-8f7b185a301b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:01:00.270387 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd749f6cc54094ef3ba5c66a4a64f90f4', 'request_id': 'req-36142876-a036-42fb-b593-8f7b185a301b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:01:00.363965 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] The token cache is being invalidate because project d749f6cc54094ef3ba5c66a4a64f90f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:01:00.364253 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:01:00.364974 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:01:00.366606 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1396/2759] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:01:00 2022] DELETE /identity/v3/projects/d749f6cc54094ef3ba5c66a4a64f90f4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:01:09.747575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:10.552751 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=5,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:01:48.222202 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:01:48.223629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:01:48.282833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b4ef9-776e-435a-9a47-bf355ad12e0f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:01:48.331485 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f72c0-ea7b-4664-889a-c2419440b475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:01:48.332127 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f72c0-ea7b-4664-889a-c2419440b475 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:01:48.332411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f72c0-ea7b-4664-889a-c2419440b475 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:01:48.332685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f72c0-ea7b-4664-889a-c2419440b475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:01:48.334486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-291f72c0-ea7b-4664-889a-c2419440b475 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:01:48.404095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f72c0-ea7b-4664-889a-c2419440b475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:01:48.405593 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f72c0-ea7b-4664-889a-c2419440b475 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:01:48.417303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1364/2760] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:01:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:01:51.608877 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:01:51.610294 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:01:51.669053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36142876-a036-42fb-b593-8f7b185a301b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:01:51.678799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d8883-51a3-4fe7-aca7-34686da25b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:01:51.678799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8883-51a3-4fe7-aca7-34686da25b93 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:01:51.678799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8883-51a3-4fe7-aca7-34686da25b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:01:51.678799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8883-51a3-4fe7-aca7-34686da25b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:01:51.679261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-014d8883-51a3-4fe7-aca7-34686da25b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:01:51.691095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d8883-51a3-4fe7-aca7-34686da25b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:01:51.692573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d8883-51a3-4fe7-aca7-34686da25b93 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:01:51.707521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1397/2761] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:01:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:01:58.411911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=74 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:02:01.699458 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=26 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:02:44.723638 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07065ed8-1adb-4a83-8f9e-7157c6bd1a1d None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:02:44.724229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07065ed8-1adb-4a83-8f9e-7157c6bd1a1d None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:02:44.724229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07065ed8-1adb-4a83-8f9e-7157c6bd1a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:02:44.742416 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-07065ed8-1adb-4a83-8f9e-7157c6bd1a1d None None] MFA Rules not processed for user `449850e1f8d144eb8b330a764882a099`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:02:44.743697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-07065ed8-1adb-4a83-8f9e-7157c6bd1a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:44.799015 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1365/2762] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:02:45.500332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d8883-51a3-4fe7-aca7-34686da25b93 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:02:45.501883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-014d8883-51a3-4fe7-aca7-34686da25b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:45.574336 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d8883-51a3-4fe7-aca7-34686da25b93 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:02:45.579332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfdf1d-5fc8-40db-848d-d3d79a615225 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:02:45.580081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfdf1d-5fc8-40db-848d-d3d79a615225 service placement] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:02:45.580369 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfdf1d-5fc8-40db-848d-d3d79a615225 service placement] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:02:45.580648 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfdf1d-5fc8-40db-848d-d3d79a615225 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:02:45.583119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-59dfdf1d-5fc8-40db-848d-d3d79a615225 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:45.594612 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfdf1d-5fc8-40db-848d-d3d79a615225 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:02:45.596282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfdf1d-5fc8-40db-848d-d3d79a615225 service placement] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:02:45.607059 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1398/2763] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:02:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:02:48.595037 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07065ed8-1adb-4a83-8f9e-7157c6bd1a1d None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:02:48.596545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-07065ed8-1adb-4a83-8f9e-7157c6bd1a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:48.609180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07065ed8-1adb-4a83-8f9e-7157c6bd1a1d None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:02:48.614909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73e7c3-5c77-487a-8283-a94a5de533de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:02:48.615715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73e7c3-5c77-487a-8283-a94a5de533de service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:02:48.615997 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73e7c3-5c77-487a-8283-a94a5de533de service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:02:48.616272 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73e7c3-5c77-487a-8283-a94a5de533de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:02:48.618023 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ae73e7c3-5c77-487a-8283-a94a5de533de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:48.628455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73e7c3-5c77-487a-8283-a94a5de533de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:02:48.629896 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73e7c3-5c77-487a-8283-a94a5de533de service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:02:48.638239 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1366/2764] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:02:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:02:54.390108 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfdf1d-5fc8-40db-848d-d3d79a615225 service placement] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:02:54.391697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-59dfdf1d-5fc8-40db-848d-d3d79a615225 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:54.407581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfdf1d-5fc8-40db-848d-d3d79a615225 service placement] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:02:54.413353 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfadb3c-c15a-4b21-b3d5-52734933e020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:02:54.413989 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfadb3c-c15a-4b21-b3d5-52734933e020 service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:02:54.414271 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfadb3c-c15a-4b21-b3d5-52734933e020 service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:02:54.414542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfadb3c-c15a-4b21-b3d5-52734933e020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:02:54.416292 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7dfadb3c-c15a-4b21-b3d5-52734933e020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:54.428517 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfadb3c-c15a-4b21-b3d5-52734933e020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:02:54.430331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfadb3c-c15a-4b21-b3d5-52734933e020 service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:02:54.441464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1399/2765] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:02:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:02:57.953937 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73e7c3-5c77-487a-8283-a94a5de533de service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:02:57.965620 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-ae73e7c3-5c77-487a-8283-a94a5de533de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:57.967668 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73e7c3-5c77-487a-8283-a94a5de533de service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:02:57.971510 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3854d1-2769-4e43-a612-6d9cb8ca4946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:02:57.972708 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3854d1-2769-4e43-a612-6d9cb8ca4946 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:02:57.972990 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3854d1-2769-4e43-a612-6d9cb8ca4946 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:02:57.973262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3854d1-2769-4e43-a612-6d9cb8ca4946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:02:57.975054 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4c3854d1-2769-4e43-a612-6d9cb8ca4946 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:58.037091 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3854d1-2769-4e43-a612-6d9cb8ca4946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:02:58.038442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3854d1-2769-4e43-a612-6d9cb8ca4946 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:02:58.048313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1367/2766] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:02:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:02:58.207261 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfadb3c-c15a-4b21-b3d5-52734933e020 service nova] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:02:58.209521 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7dfadb3c-c15a-4b21-b3d5-52734933e020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:58.225981 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfadb3c-c15a-4b21-b3d5-52734933e020 service nova] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:02:58.233004 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea9d5-ac38-4a2e-9927-9ad621ea946e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:02:58.233660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea9d5-ac38-4a2e-9927-9ad621ea946e service nova] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:02:58.233943 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea9d5-ac38-4a2e-9927-9ad621ea946e service nova] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:02:58.234221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea9d5-ac38-4a2e-9927-9ad621ea946e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:02:58.236114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-3d5ea9d5-ac38-4a2e-9927-9ad621ea946e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:02:58.250236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ea9d5-ac38-4a2e-9927-9ad621ea946e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:02:58.252184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ea9d5-ac38-4a2e-9927-9ad621ea946e service nova] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:02:58.263093 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1400/2767] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:02:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:03:06.766843 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a6a43-cac3-41a1-99ab-ff443afde23e None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:03:06.767368 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a6a43-cac3-41a1-99ab-ff443afde23e None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:03:06.767561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a6a43-cac3-41a1-99ab-ff443afde23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:03:06.785917 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d70a6a43-cac3-41a1-99ab-ff443afde23e None None] MFA Rules not processed for user `61c06d41d371486c9856a17c5b2aee20`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:03:06.787129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d70a6a43-cac3-41a1-99ab-ff443afde23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:03:06.794151 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1368/2768] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:03:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:03:07.114956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea9d5-ac38-4a2e-9927-9ad621ea946e service nova] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:03:07.124215 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea9d5-ac38-4a2e-9927-9ad621ea946e service nova] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:03:07.127687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81458c1-b578-48a0-875a-87ec88dc3e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:03:07.128328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81458c1-b578-48a0-875a-87ec88dc3e13 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:03:07.128601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81458c1-b578-48a0-875a-87ec88dc3e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:03:07.128873 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81458c1-b578-48a0-875a-87ec88dc3e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:03:07.130656 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b81458c1-b578-48a0-875a-87ec88dc3e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:03:07.149391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81458c1-b578-48a0-875a-87ec88dc3e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:03:07.149391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81458c1-b578-48a0-875a-87ec88dc3e13 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:03:07.149629 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1401/2769] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:03:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:03:12.295574 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a6a43-cac3-41a1-99ab-ff443afde23e None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:03:12.302824 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=63 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:12.310505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a6a43-cac3-41a1-99ab-ff443afde23e None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:03:12.317247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3b164-a810-4167-aaa2-5d07d7004245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aa3618089794b938018ff2666afebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:03:12.318742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b164-a810-4167-aaa2-5d07d7004245 service nova] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:03:12.319025 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b164-a810-4167-aaa2-5d07d7004245 service nova] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:03:12.319305 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b164-a810-4167-aaa2-5d07d7004245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:03:12.321243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8ac3b164-a810-4167-aaa2-5d07d7004245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:03:12.335501 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3b164-a810-4167-aaa2-5d07d7004245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:03:12.337123 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3b164-a810-4167-aaa2-5d07d7004245 service nova] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:03:12.349030 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1369/2770] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:03:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:03:17.146095 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=50 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:03:22.451000 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:15.180892 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81458c1-b578-48a0-875a-87ec88dc3e13 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:15.182381 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-b81458c1-b578-48a0-875a-87ec88dc3e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:15.250403 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81458c1-b578-48a0-875a-87ec88dc3e13 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:15.255603 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713717a-412b-4223-b020-220fd3e9d3c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:15.256245 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713717a-412b-4223-b020-220fd3e9d3c1 service placement] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:15.256531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713717a-412b-4223-b020-220fd3e9d3c1 service placement] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:15.256810 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713717a-412b-4223-b020-220fd3e9d3c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:15.258581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-1713717a-412b-4223-b020-220fd3e9d3c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:15.270853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713717a-412b-4223-b020-220fd3e9d3c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:15.276579 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713717a-412b-4223-b020-220fd3e9d3c1 service placement] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:15.282305 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1402/2771] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:04:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 09:04:15.349243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3b164-a810-4167-aaa2-5d07d7004245 service nova] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:15.350242 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8ac3b164-a810-4167-aaa2-5d07d7004245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:15.480480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3b164-a810-4167-aaa2-5d07d7004245 service nova] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:15.485660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:15.486534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:15.486817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:15.487101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] PATH_INFO: `/v3/users/449850e1f8d144eb8b330a764882a099` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:15.488335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=449850e1f8d144eb8b330a764882a099)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:15.490251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:15.741254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449850e1f8d144eb8b330a764882a099'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:15.748113 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449850e1f8d144eb8b330a764882a099'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:15.824552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449850e1f8d144eb8b330a764882a099'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:15.825167 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449850e1f8d144eb8b330a764882a099'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:15.825769 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-205e12ce-3474-4b6b-ab1f-136b7fd16556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449850e1f8d144eb8b330a764882a099'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:15.843841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1370/2772] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:04:15 2022] DELETE /identity/v3/users/449850e1f8d144eb8b330a764882a099 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:16.097801 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713717a-412b-4223-b020-220fd3e9d3c1 service placement] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:16.115963 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713717a-412b-4223-b020-220fd3e9d3c1 service placement] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:16.175737 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:16.176699 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:16.178272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:16.178272 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] PATH_INFO: `/v3/projects/f0964a125c554efe858f7695016de8db` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:16.178982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0964a125c554efe858f7695016de8db)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:16.181074 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:16.323701 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0964a125c554efe858f7695016de8db', 'request_id': 'req-64d1e4de-f0d6-4fa4-903e-8efd45320b21'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:16.331134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0964a125c554efe858f7695016de8db', 'request_id': 'req-64d1e4de-f0d6-4fa4-903e-8efd45320b21'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:16.337044 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0964a125c554efe858f7695016de8db', 'request_id': 'req-64d1e4de-f0d6-4fa4-903e-8efd45320b21'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:16.498512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] The token cache is being invalidate because project f0964a125c554efe858f7695016de8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:04:16.498799 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:16.499455 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-64d1e4de-f0d6-4fa4-903e-8efd45320b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:16.501063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1403/2773] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:04:16 2022] DELETE /identity/v3/projects/f0964a125c554efe858f7695016de8db => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:16.506046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c7474-5477-4f16-bb11-d3f2ce1f5b88 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:16.506515 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c7474-5477-4f16-bb11-d3f2ce1f5b88 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:16.506745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c7474-5477-4f16-bb11-d3f2ce1f5b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:16.533689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:16.554508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-204c7474-5477-4f16-bb11-d3f2ce1f5b88 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:16.555760 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-204c7474-5477-4f16-bb11-d3f2ce1f5b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:16.615703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1371/2774] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 09:04:16.623375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed6cd-30be-4706-a079-ffa8b8c3aadf None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:16.623671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed6cd-30be-4706-a079-ffa8b8c3aadf None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:16.623949 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed6cd-30be-4706-a079-ffa8b8c3aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:16.642631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-db5ed6cd-30be-4706-a079-ffa8b8c3aadf None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:16.643867 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-db5ed6cd-30be-4706-a079-ffa8b8c3aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:16.652109 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1404/2775] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:16.661467 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c7474-5477-4f16-bb11-d3f2ce1f5b88 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:16.671172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c7474-5477-4f16-bb11-d3f2ce1f5b88 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:16.675863 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8880e2-a5a5-45ef-bd8c-03fd584f0f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:16.676505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8880e2-a5a5-45ef-bd8c-03fd584f0f51 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:16.676785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8880e2-a5a5-45ef-bd8c-03fd584f0f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:16.677058 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8880e2-a5a5-45ef-bd8c-03fd584f0f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:16.677774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8880e2-a5a5-45ef-bd8c-03fd584f0f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:04:16.678332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8880e2-a5a5-45ef-bd8c-03fd584f0f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:16.679978 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8880e2-a5a5-45ef-bd8c-03fd584f0f51 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:16.692029 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1372/2776] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 09:04:16.700571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ed6cd-30be-4706-a079-ffa8b8c3aadf None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:16.710536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ed6cd-30be-4706-a079-ffa8b8c3aadf None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:16.715228 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c98b81-43d4-46a7-9640-9086533ec4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:16.715904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c98b81-43d4-46a7-9640-9086533ec4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:16.716188 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c98b81-43d4-46a7-9640-9086533ec4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:16.716465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c98b81-43d4-46a7-9640-9086533ec4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:16.717174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c98b81-43d4-46a7-9640-9086533ec4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:16.719118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c98b81-43d4-46a7-9640-9086533ec4d9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:16.825988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:16.833108 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1405/2777] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:04:16 2022] POST /identity/v3/projects => generated 357 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:16.837282 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8880e2-a5a5-45ef-bd8c-03fd584f0f51 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:16.847456 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8880e2-a5a5-45ef-bd8c-03fd584f0f51 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:16.907046 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59255d52-a776-4576-8c1a-c936daaa295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:16.907901 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59255d52-a776-4576-8c1a-c936daaa295d admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:16.908177 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59255d52-a776-4576-8c1a-c936daaa295d admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:16.908453 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59255d52-a776-4576-8c1a-c936daaa295d admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:16.909134 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59255d52-a776-4576-8c1a-c936daaa295d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:16.911026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59255d52-a776-4576-8c1a-c936daaa295d admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:17.019088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1373/2778] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:04:16 2022] POST /identity/v3/users => generated 279 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:17.023171 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c98b81-43d4-46a7-9640-9086533ec4d9 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:17.034427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c98b81-43d4-46a7-9640-9086533ec4d9 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:17.039093 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4e8f7-88ba-4b23-80af-e990874180ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:17.039791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e8f7-88ba-4b23-80af-e990874180ee admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:17.040141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e8f7-88ba-4b23-80af-e990874180ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:17.040422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e8f7-88ba-4b23-80af-e990874180ee admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:17.041153 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4e8f7-88ba-4b23-80af-e990874180ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:17.042807 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4e8f7-88ba-4b23-80af-e990874180ee admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:17.054702 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1406/2779] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:17.058851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59255d52-a776-4576-8c1a-c936daaa295d admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:17.069860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59255d52-a776-4576-8c1a-c936daaa295d admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:17.074710 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4f580-df4d-4c42-8245-edfcaf9d1e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:17.075408 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4f580-df4d-4c42-8245-edfcaf9d1e91 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:17.075685 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4f580-df4d-4c42-8245-edfcaf9d1e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:17.075983 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4f580-df4d-4c42-8245-edfcaf9d1e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:17.076700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4f580-df4d-4c42-8245-edfcaf9d1e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:17.078329 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4f580-df4d-4c42-8245-edfcaf9d1e91 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:17.089233 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1374/2780] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:17.093427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4e8f7-88ba-4b23-80af-e990874180ee admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:17.104420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4e8f7-88ba-4b23-80af-e990874180ee admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:17.109254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7aea5-769e-46ba-ba0c-d98844169baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:17.110141 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7aea5-769e-46ba-ba0c-d98844169baf admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:17.110646 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7aea5-769e-46ba-ba0c-d98844169baf admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:17.111072 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7aea5-769e-46ba-ba0c-d98844169baf admin admin] PATH_INFO: `/v3/projects/86b4bb43c48d483db7b8833063634d3f/users/1c45ca515fac42a781bf3b807d8e1206/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:17.125641 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7aea5-769e-46ba-ba0c-d98844169baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b4bb43c48d483db7b8833063634d3f, user_id=1c45ca515fac42a781bf3b807d8e1206, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:17.128331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7aea5-769e-46ba-ba0c-d98844169baf admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:17.233680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1407/2781] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:04:17 2022] PUT /identity/v3/projects/86b4bb43c48d483db7b8833063634d3f/users/1c45ca515fac42a781bf3b807d8e1206/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:17.244115 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0382-964e-493e-99d7-d1bded127d0a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:17.244401 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0382-964e-493e-99d7-d1bded127d0a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:17.244675 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0382-964e-493e-99d7-d1bded127d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:17.271942 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-088d0382-964e-493e-99d7-d1bded127d0a None None] MFA Rules not processed for user `1c45ca515fac42a781bf3b807d8e1206`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:17.273248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-088d0382-964e-493e-99d7-d1bded127d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:17.320792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:17.338088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1375/2782] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:17.342909 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7aea5-769e-46ba-ba0c-d98844169baf admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:17.405642 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7aea5-769e-46ba-ba0c-d98844169baf admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:17.411045 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a969fe-09e9-4e6e-a476-87586ba68c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:17.411748 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a969fe-09e9-4e6e-a476-87586ba68c46 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:17.412032 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a969fe-09e9-4e6e-a476-87586ba68c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:17.412310 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a969fe-09e9-4e6e-a476-87586ba68c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:17.412997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a969fe-09e9-4e6e-a476-87586ba68c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:17.414980 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a969fe-09e9-4e6e-a476-87586ba68c46 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:17.507480 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1408/2783] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:04:17 2022] POST /identity/v3/projects => generated 355 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 09:04:17.511713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d0382-964e-493e-99d7-d1bded127d0a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:17.523159 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d0382-964e-493e-99d7-d1bded127d0a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:17.578969 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0593581-8489-472b-8309-e77b67c537c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:17.580432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0593581-8489-472b-8309-e77b67c537c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:17.580714 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0593581-8489-472b-8309-e77b67c537c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:17.580992 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0593581-8489-472b-8309-e77b67c537c9 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:17.581677 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0593581-8489-472b-8309-e77b67c537c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:17.583608 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0593581-8489-472b-8309-e77b67c537c9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:17.730557 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1376/2784] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:04:17 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:17.734632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a969fe-09e9-4e6e-a476-87586ba68c46 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:17.745367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a969fe-09e9-4e6e-a476-87586ba68c46 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:17.750084 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0bea1-55ee-429d-8fb1-e2e916ca5601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:17.750788 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0bea1-55ee-429d-8fb1-e2e916ca5601 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:17.751640 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0bea1-55ee-429d-8fb1-e2e916ca5601 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:17.751969 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0bea1-55ee-429d-8fb1-e2e916ca5601 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:17.752695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0bea1-55ee-429d-8fb1-e2e916ca5601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:17.754282 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0bea1-55ee-429d-8fb1-e2e916ca5601 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:17.764986 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1409/2785] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:17.769847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0593581-8489-472b-8309-e77b67c537c9 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:17.779786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0593581-8489-472b-8309-e77b67c537c9 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:17.784509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd34f5-fab3-4667-835b-cb58e9c3d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:17.785383 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd34f5-fab3-4667-835b-cb58e9c3d198 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:17.785664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd34f5-fab3-4667-835b-cb58e9c3d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:17.785940 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd34f5-fab3-4667-835b-cb58e9c3d198 admin admin] PATH_INFO: `/v3/projects/10a4442d51a143549ea9badc0c2e45e2/users/6dbd82eaf9744c879096197ee4e807b5/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:17.800560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd34f5-fab3-4667-835b-cb58e9c3d198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a4442d51a143549ea9badc0c2e45e2, user_id=6dbd82eaf9744c879096197ee4e807b5, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:17.803523 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd34f5-fab3-4667-835b-cb58e9c3d198 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:17.913562 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1377/2786] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:04:17 2022] PUT /identity/v3/projects/10a4442d51a143549ea9badc0c2e45e2/users/6dbd82eaf9744c879096197ee4e807b5/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:17.917535 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0bea1-55ee-429d-8fb1-e2e916ca5601 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:17.928313 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0bea1-55ee-429d-8fb1-e2e916ca5601 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:17.983432 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d754d-dede-4d9f-97b3-b0e72dd7c8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:17.984096 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d754d-dede-4d9f-97b3-b0e72dd7c8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:17.984410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d754d-dede-4d9f-97b3-b0e72dd7c8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:17.984717 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d754d-dede-4d9f-97b3-b0e72dd7c8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:17.985942 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d754d-dede-4d9f-97b3-b0e72dd7c8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:17.987604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d754d-dede-4d9f-97b3-b0e72dd7c8d1 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:17.997366 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1410/2787] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:18.002089 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd34f5-fab3-4667-835b-cb58e9c3d198 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:18.012243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd34f5-fab3-4667-835b-cb58e9c3d198 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:18.016826 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad375b6-13e9-4357-836f-e8becc9c3277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:18.017643 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad375b6-13e9-4357-836f-e8becc9c3277 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:18.017923 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad375b6-13e9-4357-836f-e8becc9c3277 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:18.018197 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad375b6-13e9-4357-836f-e8becc9c3277 admin admin] PATH_INFO: `/v3/projects/10a4442d51a143549ea9badc0c2e45e2/users/6dbd82eaf9744c879096197ee4e807b5/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:18.020182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad375b6-13e9-4357-836f-e8becc9c3277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a4442d51a143549ea9badc0c2e45e2, user_id=6dbd82eaf9744c879096197ee4e807b5, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:18.022809 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad375b6-13e9-4357-836f-e8becc9c3277 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:18.033118 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1378/2788] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:04:18 2022] PUT /identity/v3/projects/10a4442d51a143549ea9badc0c2e45e2/users/6dbd82eaf9744c879096197ee4e807b5/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:18.044297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04520d-91f5-4c99-9339-ec42121cd5e5 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:18.044592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04520d-91f5-4c99-9339-ec42121cd5e5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:18.044876 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04520d-91f5-4c99-9339-ec42121cd5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:18.072227 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-5a04520d-91f5-4c99-9339-ec42121cd5e5 None None] MFA Rules not processed for user `6dbd82eaf9744c879096197ee4e807b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:18.073472 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-5a04520d-91f5-4c99-9339-ec42121cd5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:18.096904 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:18.140275 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1411/2789] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:18 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:18.151394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad375b6-13e9-4357-836f-e8becc9c3277 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:18.153080 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-4ad375b6-13e9-4357-836f-e8becc9c3277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:18.210354 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad375b6-13e9-4357-836f-e8becc9c3277 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:18.214047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e4869-fd0f-4644-9377-1cb768a1cda4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:18.214691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e4869-fd0f-4644-9377-1cb768a1cda4 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:18.214976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e4869-fd0f-4644-9377-1cb768a1cda4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:18.215254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e4869-fd0f-4644-9377-1cb768a1cda4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:18.225336 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e4869-fd0f-4644-9377-1cb768a1cda4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:18.226543 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e4869-fd0f-4644-9377-1cb768a1cda4 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:18.236767 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1379/2790] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:04:18 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 09:04:18.623089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04520d-91f5-4c99-9339-ec42121cd5e5 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:18.632982 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04520d-91f5-4c99-9339-ec42121cd5e5 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:18.636604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f46bc-26af-4c11-8892-fade086f9297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:18.637254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f46bc-26af-4c11-8892-fade086f9297 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:18.637586 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f46bc-26af-4c11-8892-fade086f9297 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:18.637863 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f46bc-26af-4c11-8892-fade086f9297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:18.695624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f46bc-26af-4c11-8892-fade086f9297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:18.697156 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f46bc-26af-4c11-8892-fade086f9297 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:18.706977 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1412/2791] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:04:18 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:04:28.231717 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:28.702056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=46 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:38.164560 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e4869-fd0f-4644-9377-1cb768a1cda4 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:38.228189 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e4869-fd0f-4644-9377-1cb768a1cda4 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:38.232726 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:38.233582 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:38.235716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:38.235716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] PATH_INFO: `/v3/users/1c45ca515fac42a781bf3b807d8e1206` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:38.235716 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c45ca515fac42a781bf3b807d8e1206)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:38.237321 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:38.482530 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c45ca515fac42a781bf3b807d8e1206'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:38.489516 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c45ca515fac42a781bf3b807d8e1206'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:38.587742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c45ca515fac42a781bf3b807d8e1206'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:38.588504 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c45ca515fac42a781bf3b807d8e1206'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:38.589218 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c45ca515fac42a781bf3b807d8e1206'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:38.608078 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1380/2792] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:04:38 2022] DELETE /identity/v3/users/1c45ca515fac42a781bf3b807d8e1206 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:38.612564 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed16cfd-e09c-4a93-acf9-a3b08d831178 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:38.613048 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed16cfd-e09c-4a93-acf9-a3b08d831178 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:38.613157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed16cfd-e09c-4a93-acf9-a3b08d831178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:38.631331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-8ed16cfd-e09c-4a93-acf9-a3b08d831178 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:38.632569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-8ed16cfd-e09c-4a93-acf9-a3b08d831178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:38.691569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1413/2793] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:38.701802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:38.703201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:38.782615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df1079-5bfd-46f7-99ca-711c2e89b1df admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:38.786198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905de0c7-cf1c-4090-a193-92cd20708662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:38.786844 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de0c7-cf1c-4090-a193-92cd20708662 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:38.787122 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de0c7-cf1c-4090-a193-92cd20708662 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:38.787422 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de0c7-cf1c-4090-a193-92cd20708662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:38.796761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905de0c7-cf1c-4090-a193-92cd20708662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:38.798182 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905de0c7-cf1c-4090-a193-92cd20708662 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:38.807846 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1381/2794] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:04:39.320552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed16cfd-e09c-4a93-acf9-a3b08d831178 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:39.322288 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-8ed16cfd-e09c-4a93-acf9-a3b08d831178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:39.336575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed16cfd-e09c-4a93-acf9-a3b08d831178 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:39.342203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:39.343073 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:39.343374 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:39.343669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] PATH_INFO: `/v3/projects/86b4bb43c48d483db7b8833063634d3f` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:39.344912 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b4bb43c48d483db7b8833063634d3f)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:39.346959 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:39.475485 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b4bb43c48d483db7b8833063634d3f', 'request_id': 'req-e7026bd5-9343-417e-bbe8-c2320ae6c980'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:39.482441 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b4bb43c48d483db7b8833063634d3f', 'request_id': 'req-e7026bd5-9343-417e-bbe8-c2320ae6c980'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:39.488542 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b4bb43c48d483db7b8833063634d3f', 'request_id': 'req-e7026bd5-9343-417e-bbe8-c2320ae6c980'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:39.595276 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] The token cache is being invalidate because project 86b4bb43c48d483db7b8833063634d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:04:39.595553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:39.596183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:39.597755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1414/2795] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:04:39 2022] DELETE /identity/v3/projects/86b4bb43c48d483db7b8833063634d3f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:39.601823 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905de0c7-cf1c-4090-a193-92cd20708662 service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:39.606796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:39.616796 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905de0c7-cf1c-4090-a193-92cd20708662 service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:39.670072 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:39.670965 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:39.671274 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:39.671604 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] PATH_INFO: `/v3/users/6dbd82eaf9744c879096197ee4e807b5` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:39.672783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dbd82eaf9744c879096197ee4e807b5)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:39.674664 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:39.912991 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dbd82eaf9744c879096197ee4e807b5'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:39.920273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dbd82eaf9744c879096197ee4e807b5'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:40.010179 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dbd82eaf9744c879096197ee4e807b5'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:40.010783 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dbd82eaf9744c879096197ee4e807b5'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:40.011413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-858adfd6-2e93-4fe4-aca3-8e93eaeaba6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dbd82eaf9744c879096197ee4e807b5'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:40.030128 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1382/2796] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:04:39 2022] DELETE /identity/v3/users/6dbd82eaf9744c879096197ee4e807b5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:40.482630 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:40.484856 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:40.500466 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7026bd5-9343-417e-bbe8-c2320ae6c980 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:40.557470 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:40.558319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:40.558600 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:40.558874 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] PATH_INFO: `/v3/projects/10a4442d51a143549ea9badc0c2e45e2` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:40.560185 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a4442d51a143549ea9badc0c2e45e2)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:40.562143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:40.677554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:40.693697 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a4442d51a143549ea9badc0c2e45e2', 'request_id': 'req-77b77c69-0154-447f-800d-9fd261cfc2c9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:40.699857 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a4442d51a143549ea9badc0c2e45e2', 'request_id': 'req-77b77c69-0154-447f-800d-9fd261cfc2c9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:40.706248 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a4442d51a143549ea9badc0c2e45e2', 'request_id': 'req-77b77c69-0154-447f-800d-9fd261cfc2c9'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:40.818547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] The token cache is being invalidate because project 10a4442d51a143549ea9badc0c2e45e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:04:40.818841 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:40.819501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-77b77c69-0154-447f-800d-9fd261cfc2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:40.821296 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1415/2797] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:04:40 2022] DELETE /identity/v3/projects/10a4442d51a143549ea9badc0c2e45e2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:40.827090 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bbe39-fb34-469d-84ff-14eb7e60eb52 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:40.827682 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bbe39-fb34-469d-84ff-14eb7e60eb52 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:40.827785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bbe39-fb34-469d-84ff-14eb7e60eb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:40.845757 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5e4bbe39-fb34-469d-84ff-14eb7e60eb52 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:40.852710 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5e4bbe39-fb34-469d-84ff-14eb7e60eb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:40.907421 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1383/2798] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:40.915601 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca329653-9c9d-4292-8318-2f63053274cb None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:40.915970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca329653-9c9d-4292-8318-2f63053274cb None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:40.916263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca329653-9c9d-4292-8318-2f63053274cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:40.935988 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-ca329653-9c9d-4292-8318-2f63053274cb None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:40.937196 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-ca329653-9c9d-4292-8318-2f63053274cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:40.945355 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1416/2799] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:40.949776 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bbe39-fb34-469d-84ff-14eb7e60eb52 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:40.960440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bbe39-fb34-469d-84ff-14eb7e60eb52 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:40.964999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83286f-69f6-48d3-8255-33fe72118e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:40.965639 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83286f-69f6-48d3-8255-33fe72118e78 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:40.966138 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83286f-69f6-48d3-8255-33fe72118e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:40.966417 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83286f-69f6-48d3-8255-33fe72118e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:40.967161 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83286f-69f6-48d3-8255-33fe72118e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:04:40.967534 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83286f-69f6-48d3-8255-33fe72118e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:40.969129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83286f-69f6-48d3-8255-33fe72118e78 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:40.980712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1384/2800] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 09:04:40.985008 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca329653-9c9d-4292-8318-2f63053274cb None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:40.994127 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca329653-9c9d-4292-8318-2f63053274cb None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:40.999618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05639f11-0f13-48f9-a61c-2f65600c5cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:41.000260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05639f11-0f13-48f9-a61c-2f65600c5cae admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:41.000541 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05639f11-0f13-48f9-a61c-2f65600c5cae admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:41.000817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05639f11-0f13-48f9-a61c-2f65600c5cae admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:41.001495 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05639f11-0f13-48f9-a61c-2f65600c5cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:41.003397 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05639f11-0f13-48f9-a61c-2f65600c5cae admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:41.124083 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1417/2801] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:04:40 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:41.128413 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83286f-69f6-48d3-8255-33fe72118e78 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:41.139076 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83286f-69f6-48d3-8255-33fe72118e78 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:41.143743 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:41.201588 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee11c0-67fd-4290-a777-e40a4c4c0fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:41.202255 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee11c0-67fd-4290-a777-e40a4c4c0fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:41.202540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee11c0-67fd-4290-a777-e40a4c4c0fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:41.202819 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee11c0-67fd-4290-a777-e40a4c4c0fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:41.203546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee11c0-67fd-4290-a777-e40a4c4c0fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:41.205463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee11c0-67fd-4290-a777-e40a4c4c0fa4 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:41.321654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1385/2802] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:04:41 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:41.325979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05639f11-0f13-48f9-a61c-2f65600c5cae admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:41.336588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05639f11-0f13-48f9-a61c-2f65600c5cae admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:41.341554 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae58ecd-3c7d-4603-bc0a-9cf9c506bc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:41.342206 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae58ecd-3c7d-4603-bc0a-9cf9c506bc2f admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:41.342489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae58ecd-3c7d-4603-bc0a-9cf9c506bc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:41.342765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae58ecd-3c7d-4603-bc0a-9cf9c506bc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:41.343618 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae58ecd-3c7d-4603-bc0a-9cf9c506bc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:41.345203 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae58ecd-3c7d-4603-bc0a-9cf9c506bc2f admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:41.355493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1418/2803] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:41.360344 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee11c0-67fd-4290-a777-e40a4c4c0fa4 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:41.370763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee11c0-67fd-4290-a777-e40a4c4c0fa4 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:41.376512 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1033a62-ddd1-4bd3-998a-b29425041866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:41.377111 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033a62-ddd1-4bd3-998a-b29425041866 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:41.377399 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033a62-ddd1-4bd3-998a-b29425041866 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:41.377681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033a62-ddd1-4bd3-998a-b29425041866 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:41.378405 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1033a62-ddd1-4bd3-998a-b29425041866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:41.380142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1033a62-ddd1-4bd3-998a-b29425041866 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:41.390435 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1386/2804] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:41.394515 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae58ecd-3c7d-4603-bc0a-9cf9c506bc2f admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:41.404471 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae58ecd-3c7d-4603-bc0a-9cf9c506bc2f admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:41.409011 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624f04c-459b-4af6-ad08-2f33e55f61db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:41.409880 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624f04c-459b-4af6-ad08-2f33e55f61db admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:41.410165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624f04c-459b-4af6-ad08-2f33e55f61db admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:41.410444 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624f04c-459b-4af6-ad08-2f33e55f61db admin admin] PATH_INFO: `/v3/projects/bd9b3b745c5b480ba8964e16fa8b126d/users/622005964ff04343ad4af785403604e5/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:41.425356 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624f04c-459b-4af6-ad08-2f33e55f61db admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9b3b745c5b480ba8964e16fa8b126d, user_id=622005964ff04343ad4af785403604e5, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:41.428325 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624f04c-459b-4af6-ad08-2f33e55f61db admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:41.513952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1419/2805] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:04:41 2022] PUT /identity/v3/projects/bd9b3b745c5b480ba8964e16fa8b126d/users/622005964ff04343ad4af785403604e5/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:41.524425 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46be42-19e6-4e36-b496-44679114f5ea None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:41.524730 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46be42-19e6-4e36-b496-44679114f5ea None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:41.524994 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46be42-19e6-4e36-b496-44679114f5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:41.552260 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-df46be42-19e6-4e36-b496-44679114f5ea None None] MFA Rules not processed for user `622005964ff04343ad4af785403604e5`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:41.561264 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-df46be42-19e6-4e36-b496-44679114f5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:41.617895 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1387/2806] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:41.623527 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624f04c-459b-4af6-ad08-2f33e55f61db admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:41.685569 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624f04c-459b-4af6-ad08-2f33e55f61db admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:41.690221 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0b0e6-ceac-404f-8a0e-9d2f1f0a1aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:41.690908 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0b0e6-ceac-404f-8a0e-9d2f1f0a1aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:41.691190 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0b0e6-ceac-404f-8a0e-9d2f1f0a1aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:41.691500 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0b0e6-ceac-404f-8a0e-9d2f1f0a1aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:41.692199 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0b0e6-ceac-404f-8a0e-9d2f1f0a1aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:41.694088 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0b0e6-ceac-404f-8a0e-9d2f1f0a1aa3 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:41.831961 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1420/2807] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:04:41 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:41.836095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46be42-19e6-4e36-b496-44679114f5ea None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:41.848101 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46be42-19e6-4e36-b496-44679114f5ea None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:41.905175 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d7349-d126-434d-9414-c27d81dfe984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:41.905943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d7349-d126-434d-9414-c27d81dfe984 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:41.906226 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d7349-d126-434d-9414-c27d81dfe984 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:41.906505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d7349-d126-434d-9414-c27d81dfe984 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:41.907198 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d7349-d126-434d-9414-c27d81dfe984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:41.909326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d7349-d126-434d-9414-c27d81dfe984 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:42.037301 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1388/2808] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:04:41 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:42.041067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0b0e6-ceac-404f-8a0e-9d2f1f0a1aa3 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:42.052184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0b0e6-ceac-404f-8a0e-9d2f1f0a1aa3 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:42.058862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbb26f-304b-4e7b-8137-a5a51808c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:42.059585 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbb26f-304b-4e7b-8137-a5a51808c15b admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:42.059893 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbb26f-304b-4e7b-8137-a5a51808c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:42.060173 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbb26f-304b-4e7b-8137-a5a51808c15b admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:42.060917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbb26f-304b-4e7b-8137-a5a51808c15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:42.062531 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbb26f-304b-4e7b-8137-a5a51808c15b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:42.074107 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1421/2809] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:42.083703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d7349-d126-434d-9414-c27d81dfe984 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:42.095084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d7349-d126-434d-9414-c27d81dfe984 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:42.099883 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f183d1d-3927-4186-a4cc-c38035caa78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:42.100618 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f183d1d-3927-4186-a4cc-c38035caa78b admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:42.100924 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f183d1d-3927-4186-a4cc-c38035caa78b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:42.101207 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f183d1d-3927-4186-a4cc-c38035caa78b admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:42.101930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f183d1d-3927-4186-a4cc-c38035caa78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:42.103644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f183d1d-3927-4186-a4cc-c38035caa78b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:42.104931 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:42.115119 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1389/2810] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:42.119302 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbb26f-304b-4e7b-8137-a5a51808c15b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:42.129962 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbb26f-304b-4e7b-8137-a5a51808c15b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:42.138367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bb372-a32e-4fc0-8c7d-68f4ee43af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:42.138367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bb372-a32e-4fc0-8c7d-68f4ee43af85 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:42.138367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bb372-a32e-4fc0-8c7d-68f4ee43af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:42.138367 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bb372-a32e-4fc0-8c7d-68f4ee43af85 admin admin] PATH_INFO: `/v3/projects/4d0ed803af434614a7a9b6c81c5f0c20/users/ffe26414b5a74d848193acfb73bf5da3/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:42.151821 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903bb372-a32e-4fc0-8c7d-68f4ee43af85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0ed803af434614a7a9b6c81c5f0c20, user_id=ffe26414b5a74d848193acfb73bf5da3, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:42.155258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903bb372-a32e-4fc0-8c7d-68f4ee43af85 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:42.283572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:42.289501 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1422/2811] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:04:42 2022] PUT /identity/v3/projects/4d0ed803af434614a7a9b6c81c5f0c20/users/ffe26414b5a74d848193acfb73bf5da3/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:42.300468 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145f40a-6092-4bd5-9766-9140c6df9ede None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:42.300755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145f40a-6092-4bd5-9766-9140c6df9ede None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:42.301033 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145f40a-6092-4bd5-9766-9140c6df9ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:42.328555 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-5145f40a-6092-4bd5-9766-9140c6df9ede None None] MFA Rules not processed for user `ffe26414b5a74d848193acfb73bf5da3`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:42.329830 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-5145f40a-6092-4bd5-9766-9140c6df9ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:42.393503 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1390/2812] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:42.397960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bb372-a32e-4fc0-8c7d-68f4ee43af85 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:42.459783 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bb372-a32e-4fc0-8c7d-68f4ee43af85 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:42.464464 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c5c5e-d623-4382-b3b6-549e9c8be5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:42.465112 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c5c5e-d623-4382-b3b6-549e9c8be5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:42.465391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c5c5e-d623-4382-b3b6-549e9c8be5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:42.465665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c5c5e-d623-4382-b3b6-549e9c8be5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:42.466453 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c5c5e-d623-4382-b3b6-549e9c8be5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:42.468376 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c5c5e-d623-4382-b3b6-549e9c8be5c6 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:42.580733 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1423/2813] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:04:42 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:42.584860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145f40a-6092-4bd5-9766-9140c6df9ede None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:42.595841 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145f40a-6092-4bd5-9766-9140c6df9ede None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:42.654384 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c0cb8-f319-4f8a-a3ac-fa31dafdcc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:42.655040 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0cb8-f319-4f8a-a3ac-fa31dafdcc1f admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:42.655328 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0cb8-f319-4f8a-a3ac-fa31dafdcc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:42.655637 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0cb8-f319-4f8a-a3ac-fa31dafdcc1f admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:42.656323 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c0cb8-f319-4f8a-a3ac-fa31dafdcc1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:42.658218 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c0cb8-f319-4f8a-a3ac-fa31dafdcc1f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:42.831763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1391/2814] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:04:42 2022] POST /identity/v3/users => generated 299 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:42.835665 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c5c5e-d623-4382-b3b6-549e9c8be5c6 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:42.846070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c5c5e-d623-4382-b3b6-549e9c8be5c6 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:42.850604 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e389-2252-47cf-b1f6-3ddc69500408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:42.851260 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e389-2252-47cf-b1f6-3ddc69500408 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:42.851571 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e389-2252-47cf-b1f6-3ddc69500408 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:42.851853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e389-2252-47cf-b1f6-3ddc69500408 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:42.852581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4e389-2252-47cf-b1f6-3ddc69500408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:42.854171 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4e389-2252-47cf-b1f6-3ddc69500408 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:42.864695 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1424/2815] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:42.868957 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c0cb8-f319-4f8a-a3ac-fa31dafdcc1f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:42.880088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c0cb8-f319-4f8a-a3ac-fa31dafdcc1f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:42.884625 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea682d-8e5c-4697-8f85-759432f68dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:42.885500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea682d-8e5c-4697-8f85-759432f68dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:42.885786 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea682d-8e5c-4697-8f85-759432f68dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:42.886109 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea682d-8e5c-4697-8f85-759432f68dc9 admin admin] PATH_INFO: `/v3/projects/3fb635bd675948d4a4b2b0f7eca9dea5/users/0bd68e28466b4219b2ea179b106b79e5/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:42.902396 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea682d-8e5c-4697-8f85-759432f68dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb635bd675948d4a4b2b0f7eca9dea5, user_id=0bd68e28466b4219b2ea179b106b79e5, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:42.905166 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea682d-8e5c-4697-8f85-759432f68dc9 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:43.000810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1392/2816] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:04:42 2022] PUT /identity/v3/projects/3fb635bd675948d4a4b2b0f7eca9dea5/users/0bd68e28466b4219b2ea179b106b79e5/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:43.005014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e389-2252-47cf-b1f6-3ddc69500408 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:43.016183 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e389-2252-47cf-b1f6-3ddc69500408 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:43.072680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435c93c-96c7-45f5-a877-67ff59f7bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:43.073343 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435c93c-96c7-45f5-a877-67ff59f7bcfc admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:43.073626 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435c93c-96c7-45f5-a877-67ff59f7bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:43.073900 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435c93c-96c7-45f5-a877-67ff59f7bcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:43.074624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435c93c-96c7-45f5-a877-67ff59f7bcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:43.076591 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435c93c-96c7-45f5-a877-67ff59f7bcfc admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:43.086422 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1425/2817] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:43.090686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea682d-8e5c-4697-8f85-759432f68dc9 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:43.102285 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea682d-8e5c-4697-8f85-759432f68dc9 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:43.107500 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffdaa5-4aa5-486c-b973-b434d4e15d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:43.108527 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffdaa5-4aa5-486c-b973-b434d4e15d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:43.108815 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffdaa5-4aa5-486c-b973-b434d4e15d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:43.109094 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffdaa5-4aa5-486c-b973-b434d4e15d7f admin admin] PATH_INFO: `/v3/projects/3fb635bd675948d4a4b2b0f7eca9dea5/users/0bd68e28466b4219b2ea179b106b79e5/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:43.111095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffdaa5-4aa5-486c-b973-b434d4e15d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb635bd675948d4a4b2b0f7eca9dea5, user_id=0bd68e28466b4219b2ea179b106b79e5, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:43.113911 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffdaa5-4aa5-486c-b973-b434d4e15d7f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:43.124645 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1393/2818] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:04:43 2022] PUT /identity/v3/projects/3fb635bd675948d4a4b2b0f7eca9dea5/users/0bd68e28466b4219b2ea179b106b79e5/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:43.134687 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8dbd5-f4f8-466d-90d5-e09a52b06868 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:43.135003 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8dbd5-f4f8-466d-90d5-e09a52b06868 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:43.138960 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8dbd5-f4f8-466d-90d5-e09a52b06868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:43.162014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a9d8dbd5-f4f8-466d-90d5-e09a52b06868 None None] MFA Rules not processed for user `0bd68e28466b4219b2ea179b106b79e5`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:43.163218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a9d8dbd5-f4f8-466d-90d5-e09a52b06868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:43.223828 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:43.233375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1426/2819] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:43.244088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffdaa5-4aa5-486c-b973-b434d4e15d7f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:43.245774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-f9ffdaa5-4aa5-486c-b973-b434d4e15d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:43.287428 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:43.303307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffdaa5-4aa5-486c-b973-b434d4e15d7f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:43.307098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da8199-1255-4ff5-9c9c-eabde90859cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:43.307753 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da8199-1255-4ff5-9c9c-eabde90859cd service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:43.310838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da8199-1255-4ff5-9c9c-eabde90859cd service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:43.310838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da8199-1255-4ff5-9c9c-eabde90859cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:43.317568 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da8199-1255-4ff5-9c9c-eabde90859cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:43.318987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da8199-1255-4ff5-9c9c-eabde90859cd service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:43.328275 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1394/2820] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:04:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:04:44.556935 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8dbd5-f4f8-466d-90d5-e09a52b06868 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:44.558322 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a9d8dbd5-f4f8-466d-90d5-e09a52b06868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:44.570754 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8dbd5-f4f8-466d-90d5-e09a52b06868 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:44.574220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3a79e-282c-4725-912b-ba95c09cc26e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:44.574855 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a79e-282c-4725-912b-ba95c09cc26e service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:44.575139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a79e-282c-4725-912b-ba95c09cc26e service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:44.575968 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a79e-282c-4725-912b-ba95c09cc26e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:44.630575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3a79e-282c-4725-912b-ba95c09cc26e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:44.632047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3a79e-282c-4725-912b-ba95c09cc26e service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:44.641568 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1427/2821] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:04:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:04:49.745442 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da8199-1255-4ff5-9c9c-eabde90859cd service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:49.748439 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da8199-1255-4ff5-9c9c-eabde90859cd service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:49.752650 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf07ad-2433-43a8-99fd-d44005e137e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:49.753286 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf07ad-2433-43a8-99fd-d44005e137e4 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:49.753566 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf07ad-2433-43a8-99fd-d44005e137e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:49.753840 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf07ad-2433-43a8-99fd-d44005e137e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:49.812203 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf07ad-2433-43a8-99fd-d44005e137e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:49.813772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf07ad-2433-43a8-99fd-d44005e137e4 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:49.822895 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1395/2822] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:04:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:04:54.636925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=30 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:54.772706 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3a79e-282c-4725-912b-ba95c09cc26e service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:54.835120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3a79e-282c-4725-912b-ba95c09cc26e service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:54.839645 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:54.840512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:54.840789 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:54.841062 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] PATH_INFO: `/v3/users/622005964ff04343ad4af785403604e5` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:54.842243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] RBAC: Authorizing `identity:delete_user(user_id=622005964ff04343ad4af785403604e5)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:54.844258 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:55.026995 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622005964ff04343ad4af785403604e5'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:55.040685 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622005964ff04343ad4af785403604e5'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:55.124512 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622005964ff04343ad4af785403604e5'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:55.132192 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622005964ff04343ad4af785403604e5'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:55.134028 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622005964ff04343ad4af785403604e5'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:55.139300 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1428/2823] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:04:54 2022] DELETE /identity/v3/users/622005964ff04343ad4af785403604e5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:55.144014 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d473ba-53a6-47b0-9be1-10394c1b127b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:55.144607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d473ba-53a6-47b0-9be1-10394c1b127b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:55.144607 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d473ba-53a6-47b0-9be1-10394c1b127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:55.163374 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-e9d473ba-53a6-47b0-9be1-10394c1b127b None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:55.164575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e9d473ba-53a6-47b0-9be1-10394c1b127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:55.224847 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1396/2824] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:55.235114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:55.236573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:55.292755 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b1e1-2947-415b-897b-4a2e937ecbda admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:55.296975 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d00269-0d8b-4620-8347-b92474b7937c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:55.297620 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d00269-0d8b-4620-8347-b92474b7937c service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:55.297905 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d00269-0d8b-4620-8347-b92474b7937c service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:55.298184 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d00269-0d8b-4620-8347-b92474b7937c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:55.307378 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d00269-0d8b-4620-8347-b92474b7937c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:55.308793 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d00269-0d8b-4620-8347-b92474b7937c service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:55.318389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1429/2825] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:04:55.778047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d473ba-53a6-47b0-9be1-10394c1b127b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:55.779586 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-e9d473ba-53a6-47b0-9be1-10394c1b127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:55.792231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d473ba-53a6-47b0-9be1-10394c1b127b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:55.797047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:55.797912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:55.798192 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:55.798464 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] PATH_INFO: `/v3/projects/bd9b3b745c5b480ba8964e16fa8b126d` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:55.799733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9b3b745c5b480ba8964e16fa8b126d)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:55.801561 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:55.947633 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9b3b745c5b480ba8964e16fa8b126d', 'request_id': 'req-77324949-87a0-46dd-8786-0841bf712ba7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:55.954265 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9b3b745c5b480ba8964e16fa8b126d', 'request_id': 'req-77324949-87a0-46dd-8786-0841bf712ba7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:55.959784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9b3b745c5b480ba8964e16fa8b126d', 'request_id': 'req-77324949-87a0-46dd-8786-0841bf712ba7'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:56.107289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] The token cache is being invalidate because project bd9b3b745c5b480ba8964e16fa8b126d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:04:56.111386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:56.111386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:56.111386 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1397/2826] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:04:55 2022] DELETE /identity/v3/projects/bd9b3b745c5b480ba8964e16fa8b126d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:56.114592 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d00269-0d8b-4620-8347-b92474b7937c service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:56.125136 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d00269-0d8b-4620-8347-b92474b7937c service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:56.144138 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:56.182456 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:56.183334 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:56.183770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:56.184057 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] PATH_INFO: `/v3/users/ffe26414b5a74d848193acfb73bf5da3` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:56.185250 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe26414b5a74d848193acfb73bf5da3)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:56.188120 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:56.427364 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe26414b5a74d848193acfb73bf5da3'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:56.440684 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe26414b5a74d848193acfb73bf5da3'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:56.536475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe26414b5a74d848193acfb73bf5da3'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:56.544795 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe26414b5a74d848193acfb73bf5da3'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:56.545530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe26414b5a74d848193acfb73bf5da3'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:56.552043 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1430/2827] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:04:56 2022] DELETE /identity/v3/users/ffe26414b5a74d848193acfb73bf5da3 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:57.438412 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:57.441141 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:57.463292 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:57.472865 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77324949-87a0-46dd-8786-0841bf712ba7 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:57.540514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:57.541110 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:57.541488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:57.541765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] PATH_INFO: `/v3/projects/4d0ed803af434614a7a9b6c81c5f0c20` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:57.543200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0ed803af434614a7a9b6c81c5f0c20)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:57.545176 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:57.688764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0ed803af434614a7a9b6c81c5f0c20', 'request_id': 'req-959aa92d-e074-4a07-92b5-faaa654f7775'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:57.695963 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0ed803af434614a7a9b6c81c5f0c20', 'request_id': 'req-959aa92d-e074-4a07-92b5-faaa654f7775'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:57.702230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0ed803af434614a7a9b6c81c5f0c20', 'request_id': 'req-959aa92d-e074-4a07-92b5-faaa654f7775'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:57.787397 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] The token cache is being invalidate because project 4d0ed803af434614a7a9b6c81c5f0c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:04:57.790028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:57.790028 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:57.793732 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1398/2828] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:04:57 2022] DELETE /identity/v3/projects/4d0ed803af434614a7a9b6c81c5f0c20 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:57.794945 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:57.797089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:57.812382 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba5f9-07c2-4f4a-8f7d-c281065edd1b admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:57.876595 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:57.877530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:57.877803 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:57.878079 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] PATH_INFO: `/v3/users/0bd68e28466b4219b2ea179b106b79e5` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:57.879273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd68e28466b4219b2ea179b106b79e5)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:57.881368 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:58.133283 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:58.136168 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd68e28466b4219b2ea179b106b79e5'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:58.148573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd68e28466b4219b2ea179b106b79e5'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:58.212917 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd68e28466b4219b2ea179b106b79e5'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:58.221380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd68e28466b4219b2ea179b106b79e5'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:58.222100 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-b80071ad-b91e-4fe0-b47b-a20f2c05e158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd68e28466b4219b2ea179b106b79e5'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:58.231448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1431/2829] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:04:57 2022] DELETE /identity/v3/users/0bd68e28466b4219b2ea179b106b79e5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:58.660772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:58.662334 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:58.676656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959aa92d-e074-4a07-92b5-faaa654f7775 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:58.734486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:58.735378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:58.735656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:58.735928 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] PATH_INFO: `/v3/projects/3fb635bd675948d4a4b2b0f7eca9dea5` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:58.737098 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb635bd675948d4a4b2b0f7eca9dea5)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:58.738984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:58.865858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:58.876379 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb635bd675948d4a4b2b0f7eca9dea5', 'request_id': 'req-33230ac8-748b-4e76-8231-7529f1046fb0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:58.883377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb635bd675948d4a4b2b0f7eca9dea5', 'request_id': 'req-33230ac8-748b-4e76-8231-7529f1046fb0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:58.889342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb635bd675948d4a4b2b0f7eca9dea5', 'request_id': 'req-33230ac8-748b-4e76-8231-7529f1046fb0'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:58.972392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] The token cache is being invalidate because project 3fb635bd675948d4a4b2b0f7eca9dea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:04:58.972673 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:58.973289 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-33230ac8-748b-4e76-8231-7529f1046fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:04:58.974836 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1399/2830] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:04:58 2022] DELETE /identity/v3/projects/3fb635bd675948d4a4b2b0f7eca9dea5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:58.980680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65301b43-9e14-4bd5-ad61-0f9cda1b2438 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:58.981162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65301b43-9e14-4bd5-ad61-0f9cda1b2438 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:58.981291 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65301b43-9e14-4bd5-ad61-0f9cda1b2438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:59.012425 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-65301b43-9e14-4bd5-ad61-0f9cda1b2438 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:59.013547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-65301b43-9e14-4bd5-ad61-0f9cda1b2438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:59.079218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1432/2831] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:59.089017 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ee20a-2507-43e8-95ba-e4425ef804ea None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:59.089307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ee20a-2507-43e8-95ba-e4425ef804ea None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:59.092540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ee20a-2507-43e8-95ba-e4425ef804ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:59.109331 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-707ee20a-2507-43e8-95ba-e4425ef804ea None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:59.110628 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-707ee20a-2507-43e8-95ba-e4425ef804ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:59.122088 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1400/2832] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:59.127418 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65301b43-9e14-4bd5-ad61-0f9cda1b2438 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:59.137894 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65301b43-9e14-4bd5-ad61-0f9cda1b2438 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:59.142849 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7fce6-dccf-45fe-9de0-990628117fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:59.143536 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7fce6-dccf-45fe-9de0-990628117fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:59.143817 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7fce6-dccf-45fe-9de0-990628117fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:59.144116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7fce6-dccf-45fe-9de0-990628117fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:59.144839 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7fce6-dccf-45fe-9de0-990628117fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87051) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:04:59.145143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7fce6-dccf-45fe-9de0-990628117fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:59.146844 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7fce6-dccf-45fe-9de0-990628117fd7 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:59.159042 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1433/2833] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 09:04:59.163546 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ee20a-2507-43e8-95ba-e4425ef804ea None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:59.173674 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ee20a-2507-43e8-95ba-e4425ef804ea None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:59.178712 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7638b-c834-4b40-b7f8-3cab1133d45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:59.179433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7638b-c834-4b40-b7f8-3cab1133d45a admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:59.179718 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7638b-c834-4b40-b7f8-3cab1133d45a admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:59.179998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7638b-c834-4b40-b7f8-3cab1133d45a admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:59.180690 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7638b-c834-4b40-b7f8-3cab1133d45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:59.182615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7638b-c834-4b40-b7f8-3cab1133d45a admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:59.266436 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1401/2834] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:04:59 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:59.270574 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7fce6-dccf-45fe-9de0-990628117fd7 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:59.281024 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7fce6-dccf-45fe-9de0-990628117fd7 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:59.337420 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee059-9a01-436e-80ba-144ead6cf4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:59.338099 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee059-9a01-436e-80ba-144ead6cf4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:59.338389 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee059-9a01-436e-80ba-144ead6cf4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:59.338666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee059-9a01-436e-80ba-144ead6cf4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:59.339399 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee059-9a01-436e-80ba-144ead6cf4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:59.341311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ee059-9a01-436e-80ba-144ead6cf4c2 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:59.471175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1434/2835] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:04:59 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:59.472660 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7638b-c834-4b40-b7f8-3cab1133d45a admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:59.484392 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7638b-c834-4b40-b7f8-3cab1133d45a admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:59.489236 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56aeb4c-f1c1-4d11-967e-028ff8a0f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:59.489909 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aeb4c-f1c1-4d11-967e-028ff8a0f47c admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:59.490200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aeb4c-f1c1-4d11-967e-028ff8a0f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:59.490485 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aeb4c-f1c1-4d11-967e-028ff8a0f47c admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:59.491262 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56aeb4c-f1c1-4d11-967e-028ff8a0f47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:59.492930 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56aeb4c-f1c1-4d11-967e-028ff8a0f47c admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:59.504505 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1402/2836] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:04:59.508575 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee059-9a01-436e-80ba-144ead6cf4c2 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:59.519247 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee059-9a01-436e-80ba-144ead6cf4c2 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:59.523925 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df996e5-7bca-4eab-bd80-d62cea3731ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:59.524608 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df996e5-7bca-4eab-bd80-d62cea3731ce admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:59.524875 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df996e5-7bca-4eab-bd80-d62cea3731ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:59.525151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df996e5-7bca-4eab-bd80-d62cea3731ce admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:59.525872 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df996e5-7bca-4eab-bd80-d62cea3731ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:59.527538 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df996e5-7bca-4eab-bd80-d62cea3731ce admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:59.538633 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1435/2837] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 09:04:59.542755 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56aeb4c-f1c1-4d11-967e-028ff8a0f47c admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:59.553745 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56aeb4c-f1c1-4d11-967e-028ff8a0f47c admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:59.559077 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957e3e4-bb0f-4688-a20e-4bbb6de178bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:59.560084 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957e3e4-bb0f-4688-a20e-4bbb6de178bc admin admin] REQUEST_METHOD: `PUT` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:59.560372 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957e3e4-bb0f-4688-a20e-4bbb6de178bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:59.560652 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957e3e4-bb0f-4688-a20e-4bbb6de178bc admin admin] PATH_INFO: `/v3/projects/d359c9f0a15e4578bc9ebd1f9d6532cf/users/8788d9fe5dee4c388760ff5046cad8c9/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:59.577432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957e3e4-bb0f-4688-a20e-4bbb6de178bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d359c9f0a15e4578bc9ebd1f9d6532cf, user_id=8788d9fe5dee4c388760ff5046cad8c9, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:59.580493 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957e3e4-bb0f-4688-a20e-4bbb6de178bc admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:59.669045 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1403/2838] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:04:59 2022] PUT /identity/v3/projects/d359c9f0a15e4578bc9ebd1f9d6532cf/users/8788d9fe5dee4c388760ff5046cad8c9/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:04:59.681572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d31aa-cee0-492a-9289-fcc67b808ced None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:59.681956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d31aa-cee0-492a-9289-fcc67b808ced None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:59.682433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d31aa-cee0-492a-9289-fcc67b808ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:59.710014 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-e97d31aa-cee0-492a-9289-fcc67b808ced None None] MFA Rules not processed for user `8788d9fe5dee4c388760ff5046cad8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:04:59.711239 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e97d31aa-cee0-492a-9289-fcc67b808ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:04:59.716883 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:04:59.777657 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1436/2839] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:04:59.782715 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957e3e4-bb0f-4688-a20e-4bbb6de178bc admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:59.856203 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957e3e4-bb0f-4688-a20e-4bbb6de178bc admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:04:59.862507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acce90-ecfe-438c-96c6-302049f2e59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:04:59.863189 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acce90-ecfe-438c-96c6-302049f2e59b admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:04:59.863508 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acce90-ecfe-438c-96c6-302049f2e59b admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:04:59.863790 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acce90-ecfe-438c-96c6-302049f2e59b admin admin] PATH_INFO: `/v3/projects` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:04:59.864499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acce90-ecfe-438c-96c6-302049f2e59b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:04:59.866463 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acce90-ecfe-438c-96c6-302049f2e59b admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:04:59.983623 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1404/2840] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:04:59 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:04:59.987661 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d31aa-cee0-492a-9289-fcc67b808ced None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:04:59.998342 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d31aa-cee0-492a-9289-fcc67b808ced None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:00.058375 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3afdda-41c2-4e4f-8e47-627bd2137be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:00.059114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3afdda-41c2-4e4f-8e47-627bd2137be4 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:00.059427 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3afdda-41c2-4e4f-8e47-627bd2137be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:00.059707 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3afdda-41c2-4e4f-8e47-627bd2137be4 admin admin] PATH_INFO: `/v3/users` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:00.063448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3afdda-41c2-4e4f-8e47-627bd2137be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:00.063448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3afdda-41c2-4e4f-8e47-627bd2137be4 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:00.142474 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1437/2841] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:04:59 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:05:00.146480 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acce90-ecfe-438c-96c6-302049f2e59b admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:00.158700 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acce90-ecfe-438c-96c6-302049f2e59b admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:00.166544 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770d36-633e-4d5a-b0e6-4a663ce6b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:00.171165 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770d36-633e-4d5a-b0e6-4a663ce6b6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:00.171642 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770d36-633e-4d5a-b0e6-4a663ce6b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:00.171792 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7770d36-633e-4d5a-b0e6-4a663ce6b6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:00.172554 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7770d36-633e-4d5a-b0e6-4a663ce6b6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:00.174489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7770d36-633e-4d5a-b0e6-4a663ce6b6d1 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:00.188055 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1405/2842] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:05:00.192869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3afdda-41c2-4e4f-8e47-627bd2137be4 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:00.204162 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3afdda-41c2-4e4f-8e47-627bd2137be4 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:00.209154 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82a45a-5bbc-466d-ab2f-f4837f7a06ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:00.211318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82a45a-5bbc-466d-ab2f-f4837f7a06ad admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:00.211318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82a45a-5bbc-466d-ab2f-f4837f7a06ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:00.211318 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82a45a-5bbc-466d-ab2f-f4837f7a06ad admin admin] PATH_INFO: `/v3/projects/c06c93490b924b1db20bf502e7a4c823/users/184c5c7af6374a5195dc6fde94a65d91/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:00.228653 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82a45a-5bbc-466d-ab2f-f4837f7a06ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06c93490b924b1db20bf502e7a4c823, user_id=184c5c7af6374a5195dc6fde94a65d91, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:00.231423 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82a45a-5bbc-466d-ab2f-f4837f7a06ad admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:00.361712 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1438/2843] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:05:00 2022] PUT /identity/v3/projects/c06c93490b924b1db20bf502e7a4c823/users/184c5c7af6374a5195dc6fde94a65d91/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 09:05:00.366729 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770d36-633e-4d5a-b0e6-4a663ce6b6d1 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:00.377409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7770d36-633e-4d5a-b0e6-4a663ce6b6d1 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:00.408612 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:00.434154 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaeb90c-79a7-41b7-aa01-63aefc13b389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:00.439074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeb90c-79a7-41b7-aa01-63aefc13b389 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:00.439074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeb90c-79a7-41b7-aa01-63aefc13b389 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:00.439074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeb90c-79a7-41b7-aa01-63aefc13b389 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:00.439074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaeb90c-79a7-41b7-aa01-63aefc13b389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:00.439074 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaeb90c-79a7-41b7-aa01-63aefc13b389 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:00.448178 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1406/2844] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:05:00.453089 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82a45a-5bbc-466d-ab2f-f4837f7a06ad admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:00.464119 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82a45a-5bbc-466d-ab2f-f4837f7a06ad admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:00.469178 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec6b74-4d7e-4b45-8987-c8b5c497aa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:00.470070 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec6b74-4d7e-4b45-8987-c8b5c497aa95 admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:00.470354 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec6b74-4d7e-4b45-8987-c8b5c497aa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:00.470631 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec6b74-4d7e-4b45-8987-c8b5c497aa95 admin admin] PATH_INFO: `/v3/projects/c06c93490b924b1db20bf502e7a4c823/users/184c5c7af6374a5195dc6fde94a65d91/roles/f48ecf575a01426ba9d2a703e05dca80` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:00.472658 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec6b74-4d7e-4b45-8987-c8b5c497aa95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06c93490b924b1db20bf502e7a4c823, user_id=184c5c7af6374a5195dc6fde94a65d91, role_id=f48ecf575a01426ba9d2a703e05dca80)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:00.478309 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec6b74-4d7e-4b45-8987-c8b5c497aa95 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:00.489562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1439/2845] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:05:00 2022] PUT /identity/v3/projects/c06c93490b924b1db20bf502e7a4c823/users/184c5c7af6374a5195dc6fde94a65d91/roles/f48ecf575a01426ba9d2a703e05dca80 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:00.500610 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbb6fe-6fcb-4fad-bad9-82be146323ec None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:00.500894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbb6fe-6fcb-4fad-bad9-82be146323ec None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:00.501173 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbb6fe-6fcb-4fad-bad9-82be146323ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:00.528044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-eecbb6fe-6fcb-4fad-bad9-82be146323ec None None] MFA Rules not processed for user `184c5c7af6374a5195dc6fde94a65d91`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:00.529312 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-eecbb6fe-6fcb-4fad-bad9-82be146323ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:00.598095 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1407/2846] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:00.607948 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec6b74-4d7e-4b45-8987-c8b5c497aa95 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:00.610200 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbb6fe-6fcb-4fad-bad9-82be146323ec None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:00.610676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-44ec6b74-4d7e-4b45-8987-c8b5c497aa95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:00.611545 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-eecbb6fe-6fcb-4fad-bad9-82be146323ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:00.675189 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:00.694744 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbb6fe-6fcb-4fad-bad9-82be146323ec None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:00.698550 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2108b-a121-472e-8178-fd1cbc527ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:00.699199 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2108b-a121-472e-8178-fd1cbc527ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:00.699520 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2108b-a121-472e-8178-fd1cbc527ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:00.699794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2108b-a121-472e-8178-fd1cbc527ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:00.705259 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec6b74-4d7e-4b45-8987-c8b5c497aa95 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:00.709172 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2108b-a121-472e-8178-fd1cbc527ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:00.710551 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6d33d-8ce2-45b9-b05c-353d9f89e1de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:00.710688 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2108b-a121-472e-8178-fd1cbc527ea6 service cinder] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:00.711205 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d33d-8ce2-45b9-b05c-353d9f89e1de service placement] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:00.711520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d33d-8ce2-45b9-b05c-353d9f89e1de service placement] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:00.711802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d33d-8ce2-45b9-b05c-353d9f89e1de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:00.713624 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-4ed6d33d-8ce2-45b9-b05c-353d9f89e1de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:00.720496 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1408/2847] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:05:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 09:05:00.726565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6d33d-8ce2-45b9-b05c-353d9f89e1de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:00.728721 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6d33d-8ce2-45b9-b05c-353d9f89e1de service placement] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:00.740033 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1440/2848] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:05:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:05:01.288654 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2108b-a121-472e-8178-fd1cbc527ea6 service cinder] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:01.344324 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=100 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:01.374636 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2108b-a121-472e-8178-fd1cbc527ea6 service cinder] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:01.375689 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:01.376784 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:01.377071 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:01.377346 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] PATH_INFO: `/v3/users/8788d9fe5dee4c388760ff5046cad8c9` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:01.378656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8788d9fe5dee4c388760ff5046cad8c9)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:01.380697 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:01.608271 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8788d9fe5dee4c388760ff5046cad8c9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:01.616548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8788d9fe5dee4c388760ff5046cad8c9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:01.701509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8788d9fe5dee4c388760ff5046cad8c9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:01.702761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8788d9fe5dee4c388760ff5046cad8c9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:01.703498 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8788d9fe5dee4c388760ff5046cad8c9'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:01.722361 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1409/2849] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:05:01 2022] DELETE /identity/v3/users/8788d9fe5dee4c388760ff5046cad8c9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:01.726991 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47098f41-a42c-495c-9754-5f8eeb4cb433 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:01.727530 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47098f41-a42c-495c-9754-5f8eeb4cb433 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:01.727666 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47098f41-a42c-495c-9754-5f8eeb4cb433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:01.745211 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-47098f41-a42c-495c-9754-5f8eeb4cb433 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:01.746437 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-47098f41-a42c-495c-9754-5f8eeb4cb433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:01.808319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1441/2850] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:01.818340 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:01.819833 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:01.877667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54086d46-5ae1-4144-9139-a319e01791b3 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:01.881254 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd27c1-9410-4d18-a70b-597c6a482d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:01.881898 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd27c1-9410-4d18-a70b-597c6a482d3b service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:01.882180 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd27c1-9410-4d18-a70b-597c6a482d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:01.882457 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd27c1-9410-4d18-a70b-597c6a482d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:01.892370 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd27c1-9410-4d18-a70b-597c6a482d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:01.893800 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd27c1-9410-4d18-a70b-597c6a482d3b service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:01.903894 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1410/2851] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:05:02.334589 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47098f41-a42c-495c-9754-5f8eeb4cb433 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:02.336054 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-47098f41-a42c-495c-9754-5f8eeb4cb433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:02.348149 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47098f41-a42c-495c-9754-5f8eeb4cb433 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:02.353218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:02.354319 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:02.354787 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:02.355067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] PATH_INFO: `/v3/projects/d359c9f0a15e4578bc9ebd1f9d6532cf` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:02.356333 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d359c9f0a15e4578bc9ebd1f9d6532cf)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:02.359195 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:02.486811 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd359c9f0a15e4578bc9ebd1f9d6532cf', 'request_id': 'req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:02.493347 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd359c9f0a15e4578bc9ebd1f9d6532cf', 'request_id': 'req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:02.499723 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd359c9f0a15e4578bc9ebd1f9d6532cf', 'request_id': 'req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:02.561240 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] The token cache is being invalidate because project d359c9f0a15e4578bc9ebd1f9d6532cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:05:02.561577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:02.562049 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:02.563642 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1442/2852] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:05:02 2022] DELETE /identity/v3/projects/d359c9f0a15e4578bc9ebd1f9d6532cf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:02.567596 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd27c1-9410-4d18-a70b-597c6a482d3b service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:02.577377 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd27c1-9410-4d18-a70b-597c6a482d3b service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:02.634667 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:02.635556 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:02.635838 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:02.636216 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] PATH_INFO: `/v3/users/184c5c7af6374a5195dc6fde94a65d91` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:02.637378 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184c5c7af6374a5195dc6fde94a65d91)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:02.639303 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:02.640837 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:02.918447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184c5c7af6374a5195dc6fde94a65d91'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:02.925212 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184c5c7af6374a5195dc6fde94a65d91'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:03.010345 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184c5c7af6374a5195dc6fde94a65d91'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:03.010976 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184c5c7af6374a5195dc6fde94a65d91'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:03.011627 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-3ae373fb-e212-4e4a-a314-93eebe2bcc14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184c5c7af6374a5195dc6fde94a65d91'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:03.032243 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1411/2853] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:05:02 2022] DELETE /identity/v3/users/184c5c7af6374a5195dc6fde94a65d91 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:03.509201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:03.510778 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:03.548622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f3f4-8a65-46f3-ac1d-dd4fe66b67b2 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:03.598280 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:03.606979 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:03.607861 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:03.608734 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:03.609146 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] PATH_INFO: `/v3/projects/c06c93490b924b1db20bf502e7a4c823` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:03.610326 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06c93490b924b1db20bf502e7a4c823)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:03.612402 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:03.721056 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06c93490b924b1db20bf502e7a4c823', 'request_id': 'req-6c0cc261-19e5-4284-85fc-796d842e3404'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:03.727269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06c93490b924b1db20bf502e7a4c823', 'request_id': 'req-6c0cc261-19e5-4284-85fc-796d842e3404'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:03.733765 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06c93490b924b1db20bf502e7a4c823', 'request_id': 'req-6c0cc261-19e5-4284-85fc-796d842e3404'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:03.841557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] The token cache is being invalidate because project c06c93490b924b1db20bf502e7a4c823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:05:03.847113 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:03.847113 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-6c0cc261-19e5-4284-85fc-796d842e3404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:03.847113 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1443/2854] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:05:03 2022] DELETE /identity/v3/projects/c06c93490b924b1db20bf502e7a4c823 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:03.850107 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fed1e-d5da-4bf8-a6df-58e8b372a25a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:03.850403 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fed1e-d5da-4bf8-a6df-58e8b372a25a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:03.850684 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fed1e-d5da-4bf8-a6df-58e8b372a25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:03.870956 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-a11fed1e-d5da-4bf8-a6df-58e8b372a25a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:03.872230 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-a11fed1e-d5da-4bf8-a6df-58e8b372a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:03.936817 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1412/2855] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:03.951220 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4a79d-0dc0-459e-a5c4-4f72f363b00e None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:03.951664 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4a79d-0dc0-459e-a5c4-4f72f363b00e None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:03.952031 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4a79d-0dc0-459e-a5c4-4f72f363b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:03.970307 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-42b4a79d-0dc0-459e-a5c4-4f72f363b00e None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:03.971610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-42b4a79d-0dc0-459e-a5c4-4f72f363b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:03.981743 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1444/2856] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:03.988423 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fed1e-d5da-4bf8-a6df-58e8b372a25a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:03.998283 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fed1e-d5da-4bf8-a6df-58e8b372a25a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:04.004177 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6ff1b-3e3e-4525-847a-98154d10fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:04.005203 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6ff1b-3e3e-4525-847a-98154d10fdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:04.005495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6ff1b-3e3e-4525-847a-98154d10fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:04.005774 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6ff1b-3e3e-4525-847a-98154d10fdc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:04.006495 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6ff1b-3e3e-4525-847a-98154d10fdc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:05:04.006802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6ff1b-3e3e-4525-847a-98154d10fdc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:04.008446 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6ff1b-3e3e-4525-847a-98154d10fdc3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:04.020529 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1413/2857] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 09:05:04.025139 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4a79d-0dc0-459e-a5c4-4f72f363b00e None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:04.035562 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4a79d-0dc0-459e-a5c4-4f72f363b00e None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:04.040231 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a8a7-627c-4ff6-9f31-712d47338e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:04.040879 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a8a7-627c-4ff6-9f31-712d47338e66 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:04.041157 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a8a7-627c-4ff6-9f31-712d47338e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:04.041428 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a8a7-627c-4ff6-9f31-712d47338e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:04.042102 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a8a7-627c-4ff6-9f31-712d47338e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:04.044046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a8a7-627c-4ff6-9f31-712d47338e66 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:04.168726 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1445/2858] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:05:04 2022] POST /identity/v3/projects => generated 361 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:05:04.173632 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6ff1b-3e3e-4525-847a-98154d10fdc3 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:04.184133 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6ff1b-3e3e-4525-847a-98154d10fdc3 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:04.242313 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe003ed-f841-43f0-b2fd-b71b77f84e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:04.242995 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe003ed-f841-43f0-b2fd-b71b77f84e86 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:04.243487 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe003ed-f841-43f0-b2fd-b71b77f84e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:04.243771 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe003ed-f841-43f0-b2fd-b71b77f84e86 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:04.244461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe003ed-f841-43f0-b2fd-b71b77f84e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:04.246486 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe003ed-f841-43f0-b2fd-b71b77f84e86 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:04.256455 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:04.379449 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1414/2859] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:05:04 2022] POST /identity/v3/users => generated 281 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 09:05:04.383581 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a8a7-627c-4ff6-9f31-712d47338e66 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:04.394627 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a8a7-627c-4ff6-9f31-712d47338e66 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:04.399143 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c3c6-ad4e-455b-a95b-dd148bd67143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:04.399907 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c3c6-ad4e-455b-a95b-dd148bd67143 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:04.400193 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c3c6-ad4e-455b-a95b-dd148bd67143 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:04.400565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c3c6-ad4e-455b-a95b-dd148bd67143 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:04.401297 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76c3c6-ad4e-455b-a95b-dd148bd67143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:04.402952 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76c3c6-ad4e-455b-a95b-dd148bd67143 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:04.413956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1446/2860] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:05:04.417879 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe003ed-f841-43f0-b2fd-b71b77f84e86 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:04.427958 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe003ed-f841-43f0-b2fd-b71b77f84e86 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:04.432507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03d9a1-270c-4fbc-bb91-96adb173e752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:04.433152 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03d9a1-270c-4fbc-bb91-96adb173e752 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:04.433432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03d9a1-270c-4fbc-bb91-96adb173e752 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:04.433702 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03d9a1-270c-4fbc-bb91-96adb173e752 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:04.434409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03d9a1-270c-4fbc-bb91-96adb173e752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:04.436031 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03d9a1-270c-4fbc-bb91-96adb173e752 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:04.446656 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1415/2861] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:05:04.450736 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c3c6-ad4e-455b-a95b-dd148bd67143 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:04.461565 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c3c6-ad4e-455b-a95b-dd148bd67143 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:04.466191 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec31c2-f5de-4958-94bd-11c0ee3e9fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:04.467101 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec31c2-f5de-4958-94bd-11c0ee3e9fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:04.468165 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec31c2-f5de-4958-94bd-11c0ee3e9fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:04.468552 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec31c2-f5de-4958-94bd-11c0ee3e9fcd admin admin] PATH_INFO: `/v3/projects/7b663ff4ce3740f9ad2a1224766d1f13/users/4b0b7b2720e14603938ec5221d35acbe/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:04.486331 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec31c2-f5de-4958-94bd-11c0ee3e9fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b663ff4ce3740f9ad2a1224766d1f13, user_id=4b0b7b2720e14603938ec5221d35acbe, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:04.489047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec31c2-f5de-4958-94bd-11c0ee3e9fcd admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:04.590438 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1447/2862] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:05:04 2022] PUT /identity/v3/projects/7b663ff4ce3740f9ad2a1224766d1f13/users/4b0b7b2720e14603938ec5221d35acbe/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:04.601440 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aabdd-fa52-4b4c-bcc1-37886f71331b None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:04.601723 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aabdd-fa52-4b4c-bcc1-37886f71331b None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:04.601999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2aabdd-fa52-4b4c-bcc1-37886f71331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:04.628575 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-bf2aabdd-fa52-4b4c-bcc1-37886f71331b None None] MFA Rules not processed for user `4b0b7b2720e14603938ec5221d35acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:04.629772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-bf2aabdd-fa52-4b4c-bcc1-37886f71331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:04.697619 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1416/2863] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:04.729327 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec31c2-f5de-4958-94bd-11c0ee3e9fcd admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:04.731009 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-85ec31c2-f5de-4958-94bd-11c0ee3e9fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:04.788448 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec31c2-f5de-4958-94bd-11c0ee3e9fcd admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:04.792166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa13a2e-6d32-4920-a4eb-2fba0d4b3ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:04.792806 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa13a2e-6d32-4920-a4eb-2fba0d4b3ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:04.793087 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa13a2e-6d32-4920-a4eb-2fba0d4b3ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:04.793362 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa13a2e-6d32-4920-a4eb-2fba0d4b3ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:04.801825 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa13a2e-6d32-4920-a4eb-2fba0d4b3ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:04.803656 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa13a2e-6d32-4920-a4eb-2fba0d4b3ac8 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:04.813263 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1448/2864] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:05:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:05:04.827622 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aabdd-fa52-4b4c-bcc1-37886f71331b None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:04.890026 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2aabdd-fa52-4b4c-bcc1-37886f71331b None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:04.894598 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:04.895499 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:04.895785 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:04.896062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] PATH_INFO: `/v3/users/4b0b7b2720e14603938ec5221d35acbe` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:04.897251 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0b7b2720e14603938ec5221d35acbe)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:04.899170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:05.113447 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0b7b2720e14603938ec5221d35acbe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:05.120772 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0b7b2720e14603938ec5221d35acbe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:05.201513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0b7b2720e14603938ec5221d35acbe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:05.202438 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0b7b2720e14603938ec5221d35acbe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:05.203229 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0b7b2720e14603938ec5221d35acbe'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:05.214952 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:05.223761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1417/2865] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:05:04 2022] DELETE /identity/v3/users/4b0b7b2720e14603938ec5221d35acbe => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:05.228560 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3b81-fdd4-4191-ab5d-b32bea4bba16 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:05.228852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3b81-fdd4-4191-ab5d-b32bea4bba16 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:05.229134 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3b81-fdd4-4191-ab5d-b32bea4bba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:05.248166 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-a53f3b81-fdd4-4191-ab5d-b32bea4bba16 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:05.250025 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a53f3b81-fdd4-4191-ab5d-b32bea4bba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:05.267486 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:05.312901 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1449/2866] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:05.323563 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:05.325036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:05.383956 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b023ee1-af87-4b13-9b02-313ce968d25f admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:05.388606 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd992f2-fd7d-48dc-b56f-43ace59aee19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:05.389295 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd992f2-fd7d-48dc-b56f-43ace59aee19 service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:05.389579 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd992f2-fd7d-48dc-b56f-43ace59aee19 service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:05.389854 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd992f2-fd7d-48dc-b56f-43ace59aee19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:05.399540 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd992f2-fd7d-48dc-b56f-43ace59aee19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:05.400966 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd992f2-fd7d-48dc-b56f-43ace59aee19 service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:05.410711 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1418/2867] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:05:06.031610 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f3b81-fdd4-4191-ab5d-b32bea4bba16 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:06.033174 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-a53f3b81-fdd4-4191-ab5d-b32bea4bba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:06.045274 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f3b81-fdd4-4191-ab5d-b32bea4bba16 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:06.050798 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:06.052997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:06.052997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:06.052997 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] PATH_INFO: `/v3/projects/7b663ff4ce3740f9ad2a1224766d1f13` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:06.053719 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b663ff4ce3740f9ad2a1224766d1f13)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:06.056236 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:06.217505 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b663ff4ce3740f9ad2a1224766d1f13', 'request_id': 'req-567c3422-5aa7-4200-89ba-25e8410a8ebe'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:06.225956 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b663ff4ce3740f9ad2a1224766d1f13', 'request_id': 'req-567c3422-5aa7-4200-89ba-25e8410a8ebe'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:06.234097 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b663ff4ce3740f9ad2a1224766d1f13', 'request_id': 'req-567c3422-5aa7-4200-89ba-25e8410a8ebe'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:06.318490 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] The token cache is being invalidate because project 7b663ff4ce3740f9ad2a1224766d1f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:05:06.319077 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:06.319848 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-567c3422-5aa7-4200-89ba-25e8410a8ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:06.322660 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1450/2868] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:05:06 2022] DELETE /identity/v3/projects/7b663ff4ce3740f9ad2a1224766d1f13 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:06.327615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929fbbc-4b7a-46f4-aef5-e0904fd3ac1a None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:06.328143 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929fbbc-4b7a-46f4-aef5-e0904fd3ac1a None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:06.328231 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929fbbc-4b7a-46f4-aef5-e0904fd3ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:06.349736 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-c929fbbc-4b7a-46f4-aef5-e0904fd3ac1a None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:06.351193 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-c929fbbc-4b7a-46f4-aef5-e0904fd3ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:06.430742 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1419/2869] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 09:05:06.439572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86919b-b96e-44b9-bd7d-eb3820ce5862 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:06.439869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86919b-b96e-44b9-bd7d-eb3820ce5862 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:06.440148 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86919b-b96e-44b9-bd7d-eb3820ce5862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:06.460450 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-7a86919b-b96e-44b9-bd7d-eb3820ce5862 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:06.461669 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-7a86919b-b96e-44b9-bd7d-eb3820ce5862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:06.471298 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1451/2870] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:06.479038 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929fbbc-4b7a-46f4-aef5-e0904fd3ac1a None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:06.502276 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929fbbc-4b7a-46f4-aef5-e0904fd3ac1a None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:06.508335 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae1f5-909c-4702-ab6d-1ea49b0c4852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:06.509042 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae1f5-909c-4702-ab6d-1ea49b0c4852 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:06.509332 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae1f5-909c-4702-ab6d-1ea49b0c4852 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:06.509615 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bae1f5-909c-4702-ab6d-1ea49b0c4852 admin admin] PATH_INFO: `/v3/domains` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:06.510355 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae1f5-909c-4702-ab6d-1ea49b0c4852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87052) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 09:05:06.510658 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae1f5-909c-4702-ab6d-1ea49b0c4852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:06.512382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bae1f5-909c-4702-ab6d-1ea49b0c4852 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:06.531552 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1420/2871] 10.222.0.78 () {58 vars in 1152 bytes} [Fri Jun 17 09:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 09:05:06.532700 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86919b-b96e-44b9-bd7d-eb3820ce5862 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:06.542459 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86919b-b96e-44b9-bd7d-eb3820ce5862 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:06.549279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f91fc4-3cd7-4ab5-a3c8-d2ae7033a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:06.550529 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f91fc4-3cd7-4ab5-a3c8-d2ae7033a8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:06.550993 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f91fc4-3cd7-4ab5-a3c8-d2ae7033a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:06.551279 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f91fc4-3cd7-4ab5-a3c8-d2ae7033a8e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:06.552034 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f91fc4-3cd7-4ab5-a3c8-d2ae7033a8e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:06.554970 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f91fc4-3cd7-4ab5-a3c8-d2ae7033a8e9 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:06.666731 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1452/2872] 10.222.0.78 () {60 vars in 1152 bytes} [Fri Jun 17 09:05:06 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:05:06.671642 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae1f5-909c-4702-ab6d-1ea49b0c4852 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:06.682851 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bae1f5-909c-4702-ab6d-1ea49b0c4852 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:06.758659 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3df5-d102-41f4-8f00-a82ce155cf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:06.759432 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3df5-d102-41f4-8f00-a82ce155cf02 admin admin] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:06.759763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3df5-d102-41f4-8f00-a82ce155cf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:06.759999 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3df5-d102-41f4-8f00-a82ce155cf02 admin admin] PATH_INFO: `/v3/users` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:06.760691 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb3df5-d102-41f4-8f00-a82ce155cf02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:06.762686 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb3df5-d102-41f4-8f00-a82ce155cf02 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:06.857348 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1421/2873] 10.222.0.78 () {60 vars in 1143 bytes} [Fri Jun 17 09:05:06 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 09:05:06.861172 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f91fc4-3cd7-4ab5-a3c8-d2ae7033a8e9 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:06.871976 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f91fc4-3cd7-4ab5-a3c8-d2ae7033a8e9 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:06.877118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2040b5d-98ee-493b-895b-f391ce2f4998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:06.877790 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2040b5d-98ee-493b-895b-f391ce2f4998 admin admin] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:06.878233 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2040b5d-98ee-493b-895b-f391ce2f4998 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:06.878671 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2040b5d-98ee-493b-895b-f391ce2f4998 admin admin] PATH_INFO: `/v3/roles` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:06.879491 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2040b5d-98ee-493b-895b-f391ce2f4998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:06.881116 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2040b5d-98ee-493b-895b-f391ce2f4998 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:06.893676 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1453/2874] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:05:06.897617 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3df5-d102-41f4-8f00-a82ce155cf02 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:06.909323 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3df5-d102-41f4-8f00-a82ce155cf02 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:06.914142 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e55f68-46eb-4bc5-805d-5d8c82cbdd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:06.914884 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e55f68-46eb-4bc5-805d-5d8c82cbdd47 admin admin] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:06.915170 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e55f68-46eb-4bc5-805d-5d8c82cbdd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:06.915475 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e55f68-46eb-4bc5-805d-5d8c82cbdd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:06.916206 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e55f68-46eb-4bc5-805d-5d8c82cbdd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:06.918062 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e55f68-46eb-4bc5-805d-5d8c82cbdd47 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:06.929559 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1422/2875] 10.222.0.78 () {58 vars in 1121 bytes} [Fri Jun 17 09:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 09:05:06.933871 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2040b5d-98ee-493b-895b-f391ce2f4998 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:06.944622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2040b5d-98ee-493b-895b-f391ce2f4998 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:06.949372 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9dee7-a2f2-42f9-ac88-e3611371456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:06.950268 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9dee7-a2f2-42f9-ac88-e3611371456c admin admin] REQUEST_METHOD: `PUT` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:06.950553 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9dee7-a2f2-42f9-ac88-e3611371456c admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:06.950832 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9dee7-a2f2-42f9-ac88-e3611371456c admin admin] PATH_INFO: `/v3/projects/a3661c95e2114a67b40bff418d2f0a3f/users/efd3c64044394c619a37764e64dff4a2/roles/0b03acccb970430e8e3b5a7921cb70d0` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:06.966713 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9dee7-a2f2-42f9-ac88-e3611371456c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3661c95e2114a67b40bff418d2f0a3f, user_id=efd3c64044394c619a37764e64dff4a2, role_id=0b03acccb970430e8e3b5a7921cb70d0)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:06.970125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9dee7-a2f2-42f9-ac88-e3611371456c admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:07.069115 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1454/2876] 10.222.0.78 () {60 vars in 1482 bytes} [Fri Jun 17 09:05:06 2022] PUT /identity/v3/projects/a3661c95e2114a67b40bff418d2f0a3f/users/efd3c64044394c619a37764e64dff4a2/roles/0b03acccb970430e8e3b5a7921cb70d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:07.130987 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beca365-521a-4181-9715-ec5f801b9386 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:07.131284 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beca365-521a-4181-9715-ec5f801b9386 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:07.131629 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beca365-521a-4181-9715-ec5f801b9386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:07.137411 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:07.151342 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-2beca365-521a-4181-9715-ec5f801b9386 None None] MFA Rules not processed for user `1449ff4f407540dd843ab2db406229f6`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:07.152752 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-2beca365-521a-4181-9715-ec5f801b9386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:07.215138 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1423/2877] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:07.224992 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9dee7-a2f2-42f9-ac88-e3611371456c admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:07.226680 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-48e9dee7-a2f2-42f9-ac88-e3611371456c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:07.273429 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:07.284869 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9dee7-a2f2-42f9-ac88-e3611371456c admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:07.288477 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61db9e0-2076-4bba-85dc-df1336b6a88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:07.289125 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61db9e0-2076-4bba-85dc-df1336b6a88f service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:07.289404 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61db9e0-2076-4bba-85dc-df1336b6a88f service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:07.289715 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61db9e0-2076-4bba-85dc-df1336b6a88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:07.298921 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61db9e0-2076-4bba-85dc-df1336b6a88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:07.300390 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61db9e0-2076-4bba-85dc-df1336b6a88f service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:07.310332 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1455/2878] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:05:08.805394 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2a434-7c90-4678-a49c-f5d6d3771cea None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:08.805943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2a434-7c90-4678-a49c-f5d6d3771cea None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:08.805943 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2a434-7c90-4678-a49c-f5d6d3771cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:08.837489 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-3ae2a434-7c90-4678-a49c-f5d6d3771cea None None] MFA Rules not processed for user `efd3c64044394c619a37764e64dff4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:08.838801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-3ae2a434-7c90-4678-a49c-f5d6d3771cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:08.912733 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1424/2879] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:08.923573 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61db9e0-2076-4bba-85dc-df1336b6a88f service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:08.925077 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-e61db9e0-2076-4bba-85dc-df1336b6a88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:08.984791 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61db9e0-2076-4bba-85dc-df1336b6a88f service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:08.988486 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9686e2-39a5-47d7-9ebe-cac265bf9092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7feb1014c44c5a9b3832bad417b47c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:08.989130 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9686e2-39a5-47d7-9ebe-cac265bf9092 service cinder] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:08.989412 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9686e2-39a5-47d7-9ebe-cac265bf9092 service cinder] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:08.989690 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9686e2-39a5-47d7-9ebe-cac265bf9092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:08.999725 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9686e2-39a5-47d7-9ebe-cac265bf9092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:09.001179 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9686e2-39a5-47d7-9ebe-cac265bf9092 service cinder] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:09.010547 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1456/2880] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:05:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:05:10.760247 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f33f1-3661-4ebc-a7da-6ac6ebaf75c7 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:10.760764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f33f1-3661-4ebc-a7da-6ac6ebaf75c7 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:10.760860 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f33f1-3661-4ebc-a7da-6ac6ebaf75c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:10.780273 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-d27f33f1-3661-4ebc-a7da-6ac6ebaf75c7 None None] MFA Rules not processed for user `efd3c64044394c619a37764e64dff4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:10.781631 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d27f33f1-3661-4ebc-a7da-6ac6ebaf75c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:10.788694 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1425/2881] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:11.026489 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9686e2-39a5-47d7-9ebe-cac265bf9092 service cinder] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:11.040785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9686e2-39a5-47d7-9ebe-cac265bf9092 service cinder] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:11.040785 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa85351-88dc-4b10-ae53-2f5e74034432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:11.041047 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85351-88dc-4b10-ae53-2f5e74034432 service neutron] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:11.041223 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85351-88dc-4b10-ae53-2f5e74034432 service neutron] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:11.041506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa85351-88dc-4b10-ae53-2f5e74034432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:11.043311 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9fa85351-88dc-4b10-ae53-2f5e74034432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:11.053770 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa85351-88dc-4b10-ae53-2f5e74034432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:11.055214 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa85351-88dc-4b10-ae53-2f5e74034432 service neutron] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:11.064273 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1457/2882] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:05:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:05:12.453558 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f33f1-3661-4ebc-a7da-6ac6ebaf75c7 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:12.455065 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d27f33f1-3661-4ebc-a7da-6ac6ebaf75c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:12.469433 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f33f1-3661-4ebc-a7da-6ac6ebaf75c7 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:12.473382 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a562b-9f59-4ca6-a804-72c2985e3b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '024e0e53cfdb42e88dfdfde7a79e8c75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:12.474047 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a562b-9f59-4ca6-a804-72c2985e3b3d service neutron] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:12.474360 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a562b-9f59-4ca6-a804-72c2985e3b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:12.474644 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a562b-9f59-4ca6-a804-72c2985e3b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:12.476513 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8b7a562b-9f59-4ca6-a804-72c2985e3b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:12.490311 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a562b-9f59-4ca6-a804-72c2985e3b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:12.493808 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a562b-9f59-4ca6-a804-72c2985e3b3d service neutron] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:12.510087 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1426/2883] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:05:17.080050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa85351-88dc-4b10-ae53-2f5e74034432 service neutron] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:17.089873 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-9fa85351-88dc-4b10-ae53-2f5e74034432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:17.169868 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa85351-88dc-4b10-ae53-2f5e74034432 service neutron] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:17.176479 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236e4d-a5c9-4184-b3aa-04dca27027ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:17.177159 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236e4d-a5c9-4184-b3aa-04dca27027ae service placement] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:17.177744 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236e4d-a5c9-4184-b3aa-04dca27027ae service placement] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:17.178192 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236e4d-a5c9-4184-b3aa-04dca27027ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:17.180656 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-17236e4d-a5c9-4184-b3aa-04dca27027ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:17.195080 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17236e4d-a5c9-4184-b3aa-04dca27027ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:17.197017 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17236e4d-a5c9-4184-b3aa-04dca27027ae service placement] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:17.209548 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1458/2884] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:05:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 09:05:21.326248 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a562b-9f59-4ca6-a804-72c2985e3b3d service neutron] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:21.328177 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-8b7a562b-9f59-4ca6-a804-72c2985e3b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:21.350694 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a562b-9f59-4ca6-a804-72c2985e3b3d service neutron] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:21.355509 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:21.356419 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:21.356703 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:21.357036 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] PATH_INFO: `/v3/users/61c06d41d371486c9856a17c5b2aee20` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:21.358793 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c06d41d371486c9856a17c5b2aee20)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:21.360735 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:21.588458 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c06d41d371486c9856a17c5b2aee20'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:21.596145 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c06d41d371486c9856a17c5b2aee20'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:21.687409 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c06d41d371486c9856a17c5b2aee20'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:21.688149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c06d41d371486c9856a17c5b2aee20'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:21.688764 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c06d41d371486c9856a17c5b2aee20'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:21.694149 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:21.708648 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1427/2885] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:05:21 2022] DELETE /identity/v3/users/61c06d41d371486c9856a17c5b2aee20 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:21.975632 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236e4d-a5c9-4184-b3aa-04dca27027ae service placement] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:21.986493 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236e4d-a5c9-4184-b3aa-04dca27027ae service placement] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:22.052254 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:22.058443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:22.058443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:22.058443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] PATH_INFO: `/v3/projects/4c3ecf1efb8748a0af09e501e2b9d81b` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:22.058443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3ecf1efb8748a0af09e501e2b9d81b)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:22.058443 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:22.064852 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=100 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:22.167340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3ecf1efb8748a0af09e501e2b9d81b', 'request_id': 'req-52a4e147-2589-4853-a452-70cbb56bbc07'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:22.174201 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3ecf1efb8748a0af09e501e2b9d81b', 'request_id': 'req-52a4e147-2589-4853-a452-70cbb56bbc07'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:22.180063 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3ecf1efb8748a0af09e501e2b9d81b', 'request_id': 'req-52a4e147-2589-4853-a452-70cbb56bbc07'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:22.304380 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] The token cache is being invalidate because project 4c3ecf1efb8748a0af09e501e2b9d81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:05:22.304759 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:22.305465 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:22.307098 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1459/2886] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:05:21 2022] DELETE /identity/v3/projects/4c3ecf1efb8748a0af09e501e2b9d81b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:22.311713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:22.313307 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:22.328816 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334ce13-0eec-4575-8877-6b41d100ae30 admin admin] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:22.387893 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:22.388810 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:22.389290 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:22.389585 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] PATH_INFO: `/v3/users/108bb0a8cc5b444f9c742f5d7cad8546` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:22.390765 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=108bb0a8cc5b444f9c742f5d7cad8546)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:22.392720 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:22.718548 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108bb0a8cc5b444f9c742f5d7cad8546'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:22.725488 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108bb0a8cc5b444f9c742f5d7cad8546'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:22.830056 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108bb0a8cc5b444f9c742f5d7cad8546'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:22.830681 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108bb0a8cc5b444f9c742f5d7cad8546'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:22.831281 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-0978918e-e5ba-472b-a9da-4defe06736a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108bb0a8cc5b444f9c742f5d7cad8546'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:22.849915 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1428/2887] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:05:22 2022] DELETE /identity/v3/users/108bb0a8cc5b444f9c742f5d7cad8546 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:23.146520 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:23.148823 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:23.163091 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e147-2589-4853-a452-70cbb56bbc07 admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:23.228563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:23.229446 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:23.229742 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:23.230075 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] PATH_INFO: `/v3/projects/4729c6eb33414711b24bb51b9a389fa5` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:23.231269 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4729c6eb33414711b24bb51b9a389fa5)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:23.233846 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:23.335151 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4729c6eb33414711b24bb51b9a389fa5', 'request_id': 'req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:23.341622 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4729c6eb33414711b24bb51b9a389fa5', 'request_id': 'req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:23.348007 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4729c6eb33414711b24bb51b9a389fa5', 'request_id': 'req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:23.446462 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] The token cache is being invalidate because project 4729c6eb33414711b24bb51b9a389fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87051) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:05:23.446756 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:23.447506 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-42988068-7f99-41fa-b3cc-e96a3cd0ed7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:05:23.449544 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1460/2888] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:05:23 2022] DELETE /identity/v3/projects/4729c6eb33414711b24bb51b9a389fa5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:05:28.143477 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20617b1e-95d4-4b53-a494-25ce24371421 None None] REQUEST_METHOD: `POST` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:28.144044 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20617b1e-95d4-4b53-a494-25ce24371421 None None] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:28.144191 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20617b1e-95d4-4b53-a494-25ce24371421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:28.161801 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.auth.core [None req-20617b1e-95d4-4b53-a494-25ce24371421 None None] MFA Rules not processed for user `efd3c64044394c619a37764e64dff4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=87052) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:28.163012 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-20617b1e-95d4-4b53-a494-25ce24371421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:28.218352 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1429/2889] 10.222.0.78 () {58 vars in 957 bytes} [Fri Jun 17 09:05:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:33.442929 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=73,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:38.211761 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:DELETE=12,keystone:SELECT=83,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:49.023218 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774672e-ed31-437d-ad86-66b6024559a1 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:49.023753 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774672e-ed31-437d-ad86-66b6024559a1 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:49.023862 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774672e-ed31-437d-ad86-66b6024559a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:49.085557 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-0774672e-ed31-437d-ad86-66b6024559a1 None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:05:49.086827 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0774672e-ed31-437d-ad86-66b6024559a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:49.160853 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1461/2890] 10.222.0.78 () {58 vars in 1009 bytes} [Fri Jun 17 09:05:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 09:05:49.301821 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20617b1e-95d4-4b53-a494-25ce24371421 None None] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:05:49.303536 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.fernet_utils [None req-20617b1e-95d4-4b53-a494-25ce24371421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87052) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:05:49.397746 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20617b1e-95d4-4b53-a494-25ce24371421 None None] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:05:49.402794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bf7e6-b7cf-4fad-bdd6-51e2b0384cf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:05:49.403507 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bf7e6-b7cf-4fad-bdd6-51e2b0384cf3 service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:05:49.403912 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bf7e6-b7cf-4fad-bdd6-51e2b0384cf3 service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:05:49.404871 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bf7e6-b7cf-4fad-bdd6-51e2b0384cf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:05:49.412738 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bf7e6-b7cf-4fad-bdd6-51e2b0384cf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:05:49.414317 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bf7e6-b7cf-4fad-bdd6-51e2b0384cf3 service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:05:49.422461 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1430/2891] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 09:05:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 09:05:59.157813 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=47 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:05:59.419310 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=41 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:06:07.864015 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400ea8-8ffd-4e4f-a167-659e4ea874a5 None None] REQUEST_METHOD: `POST` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:06:07.864475 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400ea8-8ffd-4e4f-a167-659e4ea874a5 None None] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:06:07.864588 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400ea8-8ffd-4e4f-a167-659e4ea874a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:06:07.881990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.auth.core [None req-66400ea8-8ffd-4e4f-a167-659e4ea874a5 None None] MFA Rules not processed for user `7687888c51224d8e94018f35a82fbcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=87051) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 09:06:07.883175 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-66400ea8-8ffd-4e4f-a167-659e4ea874a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:06:07.891391 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1462/2892] 10.222.0.78 () {58 vars in 967 bytes} [Fri Jun 17 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 09:06:07.903201 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bf7e6-b7cf-4fad-bdd6-51e2b0384cf3 service swift] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:06:07.914651 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bf7e6-b7cf-4fad-bdd6-51e2b0384cf3 service swift] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:06:07.919794 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceb6fa-8b69-4cb4-af04-dc2be01f5a9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46e2b769ba9b46778c96b2a04d45612d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:06:07.920430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceb6fa-8b69-4cb4-af04-dc2be01f5a9b service swift] REQUEST_METHOD: `GET` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:06:07.920713 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceb6fa-8b69-4cb4-af04-dc2be01f5a9b service swift] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:06:07.920989 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceb6fa-8b69-4cb4-af04-dc2be01f5a9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:06:07.929430 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dceb6fa-8b69-4cb4-af04-dc2be01f5a9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:06:07.930998 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dceb6fa-8b69-4cb4-af04-dc2be01f5a9b service swift] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:06:07.939326 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1431/2893] 10.222.0.78 () {60 vars in 1384 bytes} [Fri Jun 17 09:06:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 09:06:11.256067 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66400ea8-8ffd-4e4f-a167-659e4ea874a5 None None] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:06:11.257577 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-66400ea8-8ffd-4e4f-a167-659e4ea874a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:06:11.328046 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66400ea8-8ffd-4e4f-a167-659e4ea874a5 None None] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:06:11.332563 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:06:11.333433 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:06:11.333714 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:06:11.333990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] PATH_INFO: `/v3/users/efd3c64044394c619a37764e64dff4a2` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:06:11.335176 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd3c64044394c619a37764e64dff4a2)` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:06:11.337114 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:06:11.535144 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd3c64044394c619a37764e64dff4a2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:06:11.547802 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd3c64044394c619a37764e64dff4a2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:06:11.626990 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd3c64044394c619a37764e64dff4a2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:06:11.634425 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd3c64044394c619a37764e64dff4a2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:06:11.635053 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.notifications [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd3c64044394c619a37764e64dff4a2'} {{(pid=87051) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:06:11.641081 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1463/2894] 10.222.0.78 () {58 vars in 1223 bytes} [Fri Jun 17 09:06:11 2022] DELETE /identity/v3/users/efd3c64044394c619a37764e64dff4a2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:06:11.896984 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceb6fa-8b69-4cb4-af04-dc2be01f5a9b service swift] Authenticating user token {{(pid=87052) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:06:11.909802 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceb6fa-8b69-4cb4-af04-dc2be01f5a9b service swift] Validating token access rules against request {{(pid=87052) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:06:11.971129 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449ff4f407540dd843ab2db406229f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bb6ac161b2c421f94fa26d18ee99634', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87052) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:06:11.972022 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:06:11.972304 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:06:11.972577 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] PATH_INFO: `/v3/projects/a3661c95e2114a67b40bff418d2f0a3f` {{(pid=87052) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:06:11.973763 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3661c95e2114a67b40bff418d2f0a3f)` {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:06:11.975694 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] RBAC: Authorization granted {{(pid=87052) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:06:12.122371 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3661c95e2114a67b40bff418d2f0a3f', 'request_id': 'req-b5f40026-84b1-41b3-918f-d8d935012d19'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:06:12.128514 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3661c95e2114a67b40bff418d2f0a3f', 'request_id': 'req-b5f40026-84b1-41b3-918f-d8d935012d19'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:06:12.133902 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3661c95e2114a67b40bff418d2f0a3f', 'request_id': 'req-b5f40026-84b1-41b3-918f-d8d935012d19'} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:06:12.263858 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] The token cache is being invalidate because project a3661c95e2114a67b40bff418d2f0a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87052) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 17 09:06:12.264156 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:06:12.264771 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG keystone.notifications [None req-b5f40026-84b1-41b3-918f-d8d935012d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87052) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 17 09:06:12.266309 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: [pid: 87052|app: 0|req: 1432/2895] 10.222.0.78 () {58 vars in 1232 bytes} [Fri Jun 17 09:06:11 2022] DELETE /identity/v3/projects/a3661c95e2114a67b40bff418d2f0a3f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 09:06:21.637572 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:06:22.260005 dv-cinder-797608-33-iscsi devstack@keystone.service[87052]: DEBUG dbcounter [-] [87052] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 09:10:10.510964 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] Authenticating user token {{(pid=87051) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 09:10:10.512410 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:10:10.583434 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d380a5-5f9b-4f28-be97-b61d8ac06fab admin admin] Validating token access rules against request {{(pid=87051) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 09:10:10.642118 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a331b99-5efa-4979-accb-7f865236c6eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f79f43c31f5346d5b1e6ae6ff8c511a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e535300d1cb64f5bba44d5a23b34276a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87051) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 09:10:10.642767 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a331b99-5efa-4979-accb-7f865236c6eb service placement] REQUEST_METHOD: `GET` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 09:10:10.643050 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a331b99-5efa-4979-accb-7f865236c6eb service placement] SCRIPT_NAME: `/identity` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 09:10:10.643328 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a331b99-5efa-4979-accb-7f865236c6eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87051) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 09:10:10.645290 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.fernet_utils [None req-0a331b99-5efa-4979-accb-7f865236c6eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87051) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 09:10:10.656243 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a331b99-5efa-4979-accb-7f865236c6eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 09:10:10.657808 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a331b99-5efa-4979-accb-7f865236c6eb service placement] RBAC: Authorization granted {{(pid=87051) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 09:10:10.668069 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: [pid: 87051|app: 0|req: 1464/2896] 10.222.0.78 () {60 vars in 1365 bytes} [Fri Jun 17 09:10:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 09:10:20.663340 dv-cinder-797608-33-iscsi devstack@keystone.service[87051]: DEBUG dbcounter [-] [87051] Writing DB stats keystone:SELECT=58 {{(pid=87051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}